Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
DennisP
on July 25, 2023
|
parent
|
context
|
favorite
| on:
Guide to running Llama 2 locally
I've been wondering, is the M2's neural engine usable for this?
npsomaratna
on July 26, 2023
[–]
I think you'd need to offload the model into CoreML to do so, right? My understanding is that none of the current popular inference frameworks do this (not yet, at least).
DennisP
on July 26, 2023
|
parent
[–]
I did find some support from Apple:
https://machinelearning.apple.com/research/neural-engine-tra...
Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
