Amazon Web Services (AWS), an Amazon.com company, announced Monday that Mesolitica, a Malaysian startup specializing in training large language models (LLMs), has built a Malaysian language generative artificial intelligence (generative AI) LLM on the world’s leading cloud.

The MaLLaM LLM can understand local nuances like slang, colloquialisms that merge different dialects, Bahasa Malayu, and 16 other regional languages for use in AI assistants across industries.

Mesolitica has trained MaLLaM on 197 datasets totaling close to 200 billion tokens of publicly available Malay-specific content to provide culturally-relevant AI support for applications in customer service, content generation, and data analysis in localized languages.

Using custom ML chips, including AWS Trainium, and AWS Inferentia, Mesolitica saw compute cost savings of 87 percent while enjoying a 5.5-fold increase in throughput (transactions per second) while training MaLLaM, improving the model’s responsiveness and efficiency when used for AI assistants.

With AWS, Mesolitica can now deploy proofs of concept (PoCs) in as little as 24 hours, while the AWS Asia Pacific (Malaysia) Region provides a 20 percent reduction in latency, critical for achieving human-like conversations in AI voice assistants.

“Our biggest challenge was understanding the many local languages Malaysian patients use,” said Dr Kev Lim, CEO & Founder of health-tech startup Qmed Asia. “By leaning into Mesolitica, we can now better understand local speech patterns through MaLLam. This has enhanced the accuracy of our medical note-taking solution, strengthened patient communication, and ultimately, empowered us to deliver higher quality healthcare.”

With AWS, Malaysian enterprises using MaLLaM can improve operations with generative AI in regional languages to help underserved audiences like farmers in rural areas make data-driven decisions using real-time weather forecasts, soil health analysis, and crop viability assessments. The Malaysian government is also exploring the integration of MaLLaM into its operations, which aligns with the country’s broader goal of AI sovereignty and local data governance.

AI assistants built on MaLLaM can provide quick, accurate responses to citizens’ inquiries in multiple languages, including dialects from different Malaysian States such as Johor, Kedah, Sarawak, Selangor, and Terengganu, to ultimately improve citizen communication and data processing capabilities across the culturally diverse country.

Malaysia’s educational sector can benefit from MaLLaM through applications in language learning and research, particularly in enhancing the understanding of local languages and dialects.

“With AWS, we can deploy proofs-of-concept much faster, with the right cost-effective AI compute resources and machine learning capabilities,” said Khalil Nooh, co-founder and CEO, Mesolitica.

Mesolitica has enhanced its machine learning operations by leveraging AWS services. The company migrated its model training workloads to Amazon Elastic Cloud Compute (Amazon EC2) and deployed inference workloads using Amazon EC2 G5 instances, which provide cost-effective GPU acceleration for AI models.

To enhance its infrastructure, Mesolitica implemented Amazon Elastic Kubernetes Service (Amazon EKS) to deploy and manage ML models and applications, and to orchestrate P4 Nvidia instances. Furthermore, the company utilizes Amazon SageMaker, a fully managed ML service, to efficiently manage and prepare large data sets essential for training LLMs.

Mesolitica is part of the AWS APJ Generative AI Spotlight program, a four-week accelerator program which aims to support early-stage startups in the region that are developing generative AI applications.

The startup is also one of two Malaysian companies to receive AWS credits from the AWS Activate Program.

Mesolitica has joined the AWS Partner Network, a global program designed by AWS to assist businesses in leveraging AWS for growth and success.

“Malaysian startups can revolutionize industries through data-driven solutions and advanced technologies,” said Pete Murray, country manager, AWS Malaysia. “For GenAI to be relevant, it must be accessible and culturally integrated. Mesolitica is creating Malaysia’s first Large Language Model AI that’s tailored to the country’s diverse population. This has potential to support various sectors, from improving government services to financial inclusion. We are proud to host MaLLaM on AWS Malaysia region.”

#AWS #GenerativeAI #Mesolitica #MaLLaM #AIInMalaysia