Business Wire

Technology Innovation Institute Announces Launch of NOOR, the World’s Largest Arabic NLP Model

Share

Technology Innovation Institute (TII), a global research center and applied research pillar of Abu Dhabi’s Advanced Technology Research Council, today announced the launch of NOOR, the world’s largest Arabic natural language processing (NLP) model to date.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220411005085/en/

To view this piece of content from mms.businesswire.com, please give your consent at the top of this page.

Noor, the world's largest Arabic NLP Model - AI Cross-Center Unit, Technology Innovation Institute (Photo: AETOSWire)

TII’s team of advanced researchers and Artificial Intelligence (AI) specialists, has joined forces with LightOn, a technology company that unlocks extreme-scale machine intelligence for businesses, to transform the Arabic NLP model. The NOOR model has the capability to carry out tasks beyond the domain of language - offering end-to-end pipeline high quality data, including crawling, filtering, and curation at scale. The model facilitates extreme-scale distributed training and serving – to deliver applications with efficient inference and model specialization.

Dr. Ray O. Johnson, CEO, TII and ASPIRE, said: “With this development, we are well on track to enhance our research capabilities and credentials as well as elevate the status of Abu Dhabi and the UAE as a serious research ecosystem. Our expert teams have demonstrated yet again that this region can achieve breakthrough R&D outcomes to impact the world.”

Dr. Ebtesam Almazrouei, Director, AI Cross-Center Unit, TII, said: “Large language models have taken the world of natural language processing by storm, and we are proud to introduce this cutting-edge model with 10 billion parameters - the world’s largest Arabic NLP model. The uniquely large Arabic dataset collected to train the model is the result of months of work that included curating, scrapping, and filtering of varied sources. A special thank you to the entire team that worked on this project to make NOOR the go-to exploration model in Arabic for academicians and businesses everywhere.”

Speaking on the launch, Prof. Mérouane Debbah, Chief Researcher, Digital Science Research Center and AI Cross-Center Unit, TII, said: “With NOOR, TII has expanded the scope of the modern standard Arabic model by leveraging know-how in large language models to build cross-disciplinary, cutting-edge expertise in this new generation of AI research.”

To curate the world’s largest high-quality cross-domain Arabic datasets, NOOR’s unique dataset of more than 30 billion words combines web data with books, poetry, news articles, and technical information to significantly widen the applicability of the model.

Dr. Ebtesam Almazrouei said the NOOR model is based on the popular Transformer architecture. As a decoder-only model, similar in structure to GPT-3, it is programmed to tackle generative tasks with architecture upgraded to reflect the latest developments in the world of machine learning, including improvements such as better positional embeddings. To help ensure quality at scale in the NOOR dataset, the TII team designed an automated filtering pipeline based on machine learning techniques. These tools identify text like quality references and safeguard the model from exposure to spam content.

Leveraging state-of-the-art 3D parallelism, NOOR was trained on a High-Performance Computing resource with 128 A100 GPUs, allowing for the distribution of computations and ensuring efficient use of the available hardware resources.

The Director of the AI Cross-Center Unit noted that this was only the first step in the Unit’s efforts to contribute to the wider UAE Strategy for Artificial Intelligence.

Named for the Arabic word "light", the model has been so called to establish the correlation of the Arabic language model to enlightening the mind.

About Technology Innovation Institute (TII)

For more information, visit www.tii.ae

*Source: AETOSWire

To view this piece of content from cts.businesswire.com, please give your consent at the top of this page.

Contact information

Technology Innovation Institute
Sneha Sivanand, sneha.sivanand@tii.ae

About Business Wire

For more than 50 years, Business Wire has been the global leader in press release distribution and regulatory disclosure.

Subscribe to releases from Business Wire

Subscribe to all the latest releases from Business Wire by registering your e-mail address below. You can unsubscribe at any time.

Latest releases from Business Wire

Maxion Wheels and Challenge4 Set New Guinness World Record for High-Altitude Drive in an All-electric Vehicle23.5.2022 19:37:00 EEST | Press release

Maxion Wheels, the world’s largest wheel manufacturer, and long-distance driver Rainer Zietlow and the Challenge4 team, successfully set a new Guinness World Record for driving to the highest altitude in the all-electric VW ID.4 GTX. Equipped with Maxion’s robust, lightweight and sustainable steel wheels, the team drove to the top of Bolivia’s Uturuncu volcano, 5,816 meters above sea level, breaking the previous record set in 2020 by approx. 45 meters of altitude. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220523005816/en/ New highest altitude by an electric vehicle Guinness World Record is set by Maxion Wheels and Challenge4 with the ascent of a VW ID.4 GTX riding on Maxion steel wheels to the top of Bolivia's Uturuncu volcano. (Photo: Business Wire) Guinness World Records today presented Challenge4 with the official certificate during a press conference at the German Embassy in La Paz, Bolivia. “This world record under

Innovative IoT Modem Card From Thales Makes It Easier to Build a 5G World of Trust23.5.2022 18:15:00 EEST | Press release

Thales announces the new Cinterion® MV32 modem card that makes it quicker and easier for manufacturers to build and maintain resilient, high-performance 5G devices that will transform everyday life in the years ahead. Harnessing the full potential of 5G Mobile Broadband connectivity, the new modem card is designed to be at the heart of a wide array of demanding IoT (Internet of Things) use cases, such as securely connecting enterprises, remote patient care and intelligent monitoring of renewable energy generation. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220522005024/en/ Thales 5G IoT (Graphic: Thales) Effortlessly connecting 5G networks and next-gen IoT devices The 5G roll-out will not only bring unprecedented mobile broadband speed to billions of people worldwide. It also offers an extraordinary leap in the sheer number of devices that cellular networks can support. Connectivity will be enabled for billions more mach

Fabasoft Approve is now an autonomous limited liability company23.5.2022 17:05:00 EEST | Press release

Fabasoft Approve, the product for managing technical data and documents launched by software manufacturer Fabasoft and employed successfully in industry since 2019, became an independent company on April 27, 2022. Entrepreneur Andreas Dangl will assume the management of the new digitalization services company. As a defining leader in the Fabasoft Group, Dangl was responsible for the development of Fabasoft Cloud technology and was both the idea generator as well as the principal architect of software products including Fabasoft Approve. He is now pooling his expertise in the corporation based in Linz (Austria) with the express intention of re-imagining the digital world in mechanical and plant engineering and rendering it simpler to navigate. “Fabasoft Approve GmbH provides the perfect framework for meeting the needs of our industrial customers in an even more focused way. We have exciting times ahead of us, in which my team and I, together with our clients, will tap the innovative pot

“PUMA and the Land of Games”: New Virtual Place on Roblox for PUMA Fans to Connect and Compete23.5.2022 17:00:00 EEST | Press release

PUMA in partnership with Wonder Works studio launches a vibrant and immersive sports-based experience on Roblox, a global online platform connecting millions of people through shared experiences. PUMA and the Land of Games experience features Roblox newest Layered Clothing technology, where players can customize their characters with hyperrealistic clothing that fits any avatar body type to wear PUMA from head to toe. As they explore the experience, fans will unlock new zones and additional PUMA sportswear pieces. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220523005611/en/ PUMA in partnership with Wonder Works studio launches a vibrant and immersive sports-based experience on Roblox, a global online platform connecting millions of people through shared experiences. (Photo: Business Wire) “PUMA and the Land of Games” offers the global Roblox community to bring out their inner athlete through sports mini games and training

Fabrice Tocco, Dawex co-CEO, Speaking at the World Economic Forum Annual Meeting in Davos about Data Ecosystems to Respond to Competitiveness and Economic Sovereignty Challenges23.5.2022 16:40:00 EEST | Press release

Dawex, the leading technology company for data exchange, data marketplace and data hub, announced today that co-CEO Fabrice Tocco will be speaking at the World Economic Forum Annual Meeting in Davos, and will share his vision on creating new data exchange ecosystems to respond to environmental and economic challenges. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220523005654/en/ Live Session at Davos (Photo: Dawex) “Strengthening Trust in Public-Private Data Exchanges” Tuesday, May 24 at 13:30 CET Data ecosystems have become a fundamental component of business competitiveness and economic sovereignty. In today’s economy where data has become a product of unlimited potential, with its own value, and a source of new revenue streams, Dawex technology allows organizations to create new ecosystems around data exchange platforms that meet regulatory requirements and address traceability and security challenges. About Dawex In to

In our pressroom you can read all our latest releases, find our press contacts, images, documents and other relevant information about us.

Visit our pressroom