Hacker News 首頁上看到 Georgi Gerganov 成立公司的計畫:「GGML – AI at the Edge (ggml.ai)」,官網在「GGML - AI at the edge」。
如同 Georgi Gerganov 提到的,llama.cpp 這些專案本來是他的 side project,結果意外的紅起來:
I've started a company: https://t.co/jFknDoasSy
From a fun side project just a few months ago, ggml has now become a useful library and framework for machine learning with a great open-source community
— Georgi Gerganov (@ggerganov) June 6, 2023
另外他提到了 Nat Friedman 與 Daniel Gross 也幫了一把:
I'm incredibly grateful to @natfriedman and @danielgross for the support & funding and also for helping me get inspired even more in this project
There is still a long way ahead with many ideas to try and cool things to do. Hope you will join and help us create something useful!
— Georgi Gerganov (@ggerganov) June 6, 2023
在官網則是有提到是 pre-seed funding:
ggml.ai is a company founded by Georgi Gerganov to support the development of ggml. Nat Friedman and Daniel Gross provided the pre-seed funding.
現在回頭來看,當初 llama.cpp 會紅起來主要是因為 CPU 可以跑 LLaMA 7B,而且用 CPU 跑起來其實也不算慢。
後來吸引了很多人一起幫忙,於是有了不少 optimization (像是「llama.cpp 的載入速度加速」這邊用 mmap 減少需要載入的時間,並且讓多個 process 之間可以重複使用 cache),接下來又有 GPU 的支援...
但不確定他開公司後,長遠的計畫是什麼...?