Technology Innovation Institute Announces Launch of NOOR, the World’s Largest Arabic NLP Model
Technology Innovation Institute (TII), a global research center and applied research pillar of Abu Dhabi’s Advanced Technology Research Council, today announced the launch of NOOR, the world’s largest Arabic natural language processing (NLP) model to date.
This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20220411005085/en/
Noor, the world's largest Arabic NLP Model - AI Cross-Center Unit, Technology Innovation Institute (Photo: AETOSWire)
TII’s team of advanced researchers and Artificial Intelligence (AI) specialists, has joined forces with LightOn, a technology company that unlocks extreme-scale machine intelligence for businesses, to transform the Arabic NLP model. The NOOR model has the capability to carry out tasks beyond the domain of language - offering end-to-end pipeline high quality data, including crawling, filtering, and curation at scale. The model facilitates extreme-scale distributed training and serving – to deliver applications with efficient inference and model specialization.
Dr. Ray O. Johnson, CEO, TII and ASPIRE, said: “With this development, we are well on track to enhance our research capabilities and credentials as well as elevate the status of Abu Dhabi and the UAE as a serious research ecosystem. Our expert teams have demonstrated yet again that this region can achieve breakthrough R&D outcomes to impact the world.”
Dr. Ebtesam Almazrouei, Director, AI Cross-Center Unit, TII, said: “Large language models have taken the world of natural language processing by storm, and we are proud to introduce this cutting-edge model with 10 billion parameters - the world’s largest Arabic NLP model. The uniquely large Arabic dataset collected to train the model is the result of months of work that included curating, scrapping, and filtering of varied sources. A special thank you to the entire team that worked on this project to make NOOR the go-to exploration model in Arabic for academicians and businesses everywhere.”
Speaking on the launch, Prof. Mérouane Debbah, Chief Researcher, Digital Science Research Center and AI Cross-Center Unit, TII, said: “With NOOR, TII has expanded the scope of the modern standard Arabic model by leveraging know-how in large language models to build cross-disciplinary, cutting-edge expertise in this new generation of AI research.”
To curate the world’s largest high-quality cross-domain Arabic datasets, NOOR’s unique dataset of more than 30 billion words combines web data with books, poetry, news articles, and technical information to significantly widen the applicability of the model.
Dr. Ebtesam Almazrouei said the NOOR model is based on the popular Transformer architecture. As a decoder-only model, similar in structure to GPT-3, it is programmed to tackle generative tasks with architecture upgraded to reflect the latest developments in the world of machine learning, including improvements such as better positional embeddings. To help ensure quality at scale in the NOOR dataset, the TII team designed an automated filtering pipeline based on machine learning techniques. These tools identify text like quality references and safeguard the model from exposure to spam content.
Leveraging state-of-the-art 3D parallelism, NOOR was trained on a High-Performance Computing resource with 128 A100 GPUs, allowing for the distribution of computations and ensuring efficient use of the available hardware resources.
The Director of the AI Cross-Center Unit noted that this was only the first step in the Unit’s efforts to contribute to the wider UAE Strategy for Artificial Intelligence.
Named for the Arabic word "light", the model has been so called to establish the correlation of the Arabic language model to enlightening the mind.
About Technology Innovation Institute (TII)
For more information, visit www.tii.ae
To view this piece of content from cts.businesswire.com, please give your consent at the top of this page.
View source version on businesswire.com: https://www.businesswire.com/news/home/20220411005085/en/
Technology Innovation Institute
Sneha Sivanand, firstname.lastname@example.org
About Business Wire
For more than 50 years, Business Wire has been the global leader in press release distribution and regulatory disclosure.
Subscribe to releases from Business Wire
Subscribe to all the latest releases from Business Wire by registering your e-mail address below. You can unsubscribe at any time.
Latest releases from Business Wire
UAE’s In-Country Value Projects Driving Billions to Local Firms1.6.2023 19:40:00 EEST | Press release
More than $27.23 billion has been redirected to the local economy since the UAE Ministry of Industry and Advanced Technology (MoIAT) and ADNOC launched major in-country value programs to support domestic industries. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20230601005886/en/ Sideline of Make It In The Emirates Forum (Photo: AETOSWire) Speaking at the Make in the Emirates Forum today, His Excellency Abdulla Al Shamsi, Assistant Undersecretary of MoIAT, said more than $14.43 billion of investment was redirected to the local economy last year alone, an increase of 25 percent year-on-year. “The National In-Country Value Program is a nationwide program that speaks one language across many different sectors,” HE said. “It’s one methodology and this is something we’re very proud of because it benefits the private sector and when the private sector sees this it helps them prepare, invest, and spend.” The forum heard how the Nati
Carbios and Indorama Ventures Reaffirm Partnership to Build First-of-a-kind PET Biorecycling Plant in France1.6.2023 19:30:00 EEST | Press release
Regulatory News: This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20230601005872/en/ Carbios and Indorama Ventures reaffirm partnership to build first-of-a-kind PET biorecycling plant in France Carbios (Euronext Growth Paris: ALCRB), a biotech company developing and industrializing biological solutions to reinvent the life cycle of plastic and textiles, and Indorama Ventures Public Company Limited (IVL) (Bloomberg ticker IVL.TB), a global sustainable chemical producer, announce today the signing of a non-binding Memorandum of Understanding (MOU) to form a Joint Venture for the construction of the world’s first PET biorecycling plant in France1. Based on and subject to the comprehensive terms set out in the MOU, Indorama Ventures plans to mobilize about €110 million for the Joint Venture in equity and non-convertible loan financing2, pending final engineering documentation and final economic feasibility studies. Both parties have
PPG opens Color Creation Lab with Chery Automobile in China1.6.2023 16:01:00 EEST | Press release
PPG (NYSE:PPG) today announced the opening of a Color Creation Lab in collaboration with automaker Chery Automobile Co., Ltd. At the facility, located in Wuhu, China, PPG color stylists and Chery designers will create new colors tailored to specific vehicle designs, from initial color recommendations to final materials for application in Chery’s manufacturing plants. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20230601005119/en/ Representatives from PPG and Chery Automobile celebrate the opening of a Color Creation Lab in Wuhu, China. (Photo: PPG) “As the leading single-source coatings supplier for automotive manufacturing, PPG is excited to partner with Chery, a company that prioritizes technological innovation and sustainable production,” said Thomas Li, PPG vice president Asia Pacific, Automotive Coatings. “We will leverage our global color leadership to predict future trends, while advancing paint technology for the nex
HEINZ® Unveils First Global Creative Brand Platform in Over 150 Years1.6.2023 16:00:00 EEST | Press release
Today, HEINZ announces “It Has to be HEINZ,” a new global platform marking the first time in its 150-year history where the brand is unified under one creative strategy. The campaign pays homage to the brand by celebrating the irrational love people have for HEINZ – from real fans’ personal love affairs with the brand, to the love and care its products are made with. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20230601005186/en/ HEINZ announces its first new global platform in its 150-year history “It Has to be HEINZ,” inspired by real-life stories of fans’ undeniable love of HEINZ (Graphic: Business Wire) Anchored by Kraft HEINZ’s largest media investment to date, the global creative platform demonstrates the unmatched love generations of people all over the world have for HEINZ – from Ketchup to Beanz and everything in-between(z). The fan stories featured in the creative – such as HEINZ tattoos, carrying condiment packets
PPG opens $30-million battery pack application center in China1.6.2023 16:00:00 EEST | Press release
PPG (NYSE: PPG) today announced that it has inaugurated a battery pack application center (BPAC) in Tianjin, China. The $30-million facility features a full range of capabilities to test the application of PPG coatings technologies, materials and systems for electric vehicle (EV) battery packs, allowing customers to accelerate the development of new EV technologies. This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20230601005106/en/ PPG has inaugurated a $30-million facility in Tianjin, China to test coatings technologies, materials and systems for electric vehicle battery packs. (Photo: Business Wire) “The new application center is an important milestone in our effort to support our customers in China in the EV battery market,” said Vincent Robin, PPG global vice president, Automotive Coatings. “The new facility will be an important way for customers to validate our customizable coatings solutions that help them reduce applicat
In our pressroom you can read all our latest releases, find our press contacts, images, documents and other relevant information about us.Visit our pressroom