In October 2021, the revelation was made by Mark Zuckerberg that Facebook had undergone a transformation and was now known as Meta. This singular decision served as a definitive affirmation of the company’s dedication to the metaverse.
However, after two and a half years, Zuckerberg himself has shifted focus, redirecting the long-term focus towards artificial intelligence, specifically artificial general intelligence. Meta aspires to cultivate artificial general intelligence (AGI), as revealed by Zuckerberg on his Instagram account.
In his statement, he articulated that their overarching vision involves the responsible development of general (artificial) intelligence and its subsequent accessibility through Open Source, ensuring widespread benefits for all.
Zuckerberg has referred to three models that are currently under development at Meta. The ongoing Meta model, Llama 2, is already being surpassed by its upcoming successor. According to Zuckerberg’s explanation, their team is presently engaged in the training of the subsequent generation model, Llama 3, while simultaneously establishing an extensive computing infrastructure to facilitate their future roadmap.
The intention expressed by Mark Zuckerberg is to potentially release the hypothetical AGI model as Open Source, although there exists a degree of uncertainty. In an interview with The Verge, Zuckerberg conveyed that the decision to make it open source would be determined based on its feasibility, safety, and responsible implications.
He further added that it is important not to be compelled into a specific course of action solely because of a prior statement, thereby indicating the possibility of reconsidering the decision if deemed necessary.
To establish their extensive infrastructure, Meta plans to acquire a substantial number of NVIDIA H100 cards. Mark Zuckerberg has indicated that they will add 350,000 of these cards to their existing collection, resulting in a total equivalent of 600,000 H100 GPUs when considering other graphics cards already present in their facilities.
This significant investment in hardware aligns with Meta’s objective of developing artificial general intelligence and making it widely accessible While Zuckerberg expressed the intention to potentially release the AGI model as Open Source, he emphasized the importance of evaluating its feasibility, safety, and responsible implications before making a final decision.
It is worth noting that Zuckerberg also acknowledged the need to retain flexibility in decision-making, stating that they should not feel compelled to follow through on a commitment if circumstances warrant a change.