Conversation

OK this is important: Now you can train model on your mac. No more renting A100's clusters.

Training neural networks on Apple Neural Engine via reverse-engineered private APIs

https://github.com/maderix/ANE

1
1
0
@bluedevil
"Some coverage of this project has overstated its implications. To be clear:

Training works, but utilization is low (~2-3% of peak) with significant engineering challenges remaining
Many element-wise operations still fall back to CPU
This does not replace GPU training for anything beyond small research models today"
1
1
1