The Technology Innovation Institute (TII), the applied research arm of Abu Dhabi’s Advanced Technology Research Council (ATRC), has introduced a new large language model (LLM) called Falcon LLM. Developed by the AI and Digital Science Research Center’s (AIDRC) AI Cross-Center Unit, Falcon LLM has 40 billion parameters, making it a foundational model that outperforms ChatGPT 3.
Falcon LLM was trained on one trillion tokens, using only 75% of the training compute of GPT-3, 40% of Chinchilla’s, and 80% of PaLM-62B’s. Falcon LLM’s impressive performance has significant implications for various sectors, including healthcare, education, film production, and CGI.
LLMs have the potential to revolutionize industries by generating creative text, solving complex problems, and streamlining customer service operations. The model can be utilized in applications such as chatbots, virtual assistants, language translation, content generation, and sentiment analysis.
Dr Ray O. Johnson, CEO of TII, noted that Falcon LLM is a landmark announcement for the institute and just the beginning of a momentous journey. He further emphasized that by the end of 2023, they will be announcing a huge increase in capabilities in this space, well-aligned with the UAE’s National AI Strategy.
Prof. Mérouane Debbah, Chief Researcher at the AI and Digital Science Research Center, added that Falcon LLM will have a significant impact on the economy as the UAE continues to develop and diversify its economy.
Meanwhile, Dr Ebtesam Almazroui, Director of the AI Cross-Center Unit at AIDRC, and project lead of LLMs emphasized that Falcon LLM’s achievement serves as a testament to the UAE’s forward-thinking approach and the importance it places on innovation and technology.
About Author
