Any links to online stores should be assumed to be affiliates. The company or PR agency provides all or most review samples. They have no control over my content, and I provide my honest opinion.
Today, MediaTek has announced a partnership with Meta’s Llama 2, their forthcoming open-source Large Language Model (LLM). By leveraging both the LLM and MediaTek’s innovative APUs and NeuroPilot AI Platform, the goal is to establish a comprehensive edge computing framework. This will boost AI development across platforms like smartphones, IoT, cars, and smart homes.
Key points:
- Generative AI applications will now be able to operate directly on devices, contrasting the prevailing cloud-based processing approach.
- Running computations on-device offers enhanced performance, heightened privacy, stronger security, improved reliability, reduced delay, functionality in low-connectivity zones, and cost savings.
- By year-end, smartphones equipped with MediaTek’s upcoming flagship SoC are anticipated to support Llama 2-driven AI apps.
While most Generative AI processing currently relies on cloud-based solutions, MediaTek’s integration of the Llama 2 models will empower devices to handle generative AI tasks directly. This shift offers multiple benefits: improved performance, heightened privacy, stronger security, reduced latency, offline operation capability, and cost-effectiveness.
For edge devices to harness the full potential of on-device Generative AI, they must embrace potent, energy-efficient AI chips and superior connectivity. MediaTek’s 5G smartphone SoCs, available now, are already loaded with APUs capable of executing diverse Generative AI tasks, such as AI Noise Reduction and AI Super Resolution.
Furthermore, MediaTek will soon launch a flagship chipset boasting a software suite fine-tuned for Llama 2, an advanced APU with Transformer acceleration, and a more efficient DRAM bandwidth usage. These enhancements expedite the development of Generative AI use cases.
JC Hsu, Senior VP and GM of Wireless Communications at MediaTek, expressed, “Generative AI’s rising prominence is reshaping the digital landscape. Our aim is to equip the Llama 2 developer community with top-tier tools for AI innovation. Collaborating with Meta, we’re poised to redefine edge capabilities.”
By year-end, smartphones featuring MediaTek’s upcoming flagship SoC are expected to support Llama 2-driven AI apps.
I am James, a UK-based tech enthusiast and the Editor and Owner of Mighty Gadget, which I’ve proudly run since 2007. Passionate about all things technology, my expertise spans from computers and networking to mobile, wearables, and smart home devices.
As a fitness fanatic who loves running and cycling, I also have a keen interest in fitness-related technology, and I take every opportunity to cover this niche on my blog. My diverse interests allow me to bring a unique perspective to tech blogging, merging lifestyle, fitness, and the latest tech trends.
In my academic pursuits, I earned a BSc in Information Systems Design from UCLAN, before advancing my learning with a Master’s Degree in Computing. This advanced study also included Cisco CCNA accreditation, further demonstrating my commitment to understanding and staying ahead of the technology curve.
I’m proud to share that Vuelio has consistently ranked Mighty Gadget as one of the top technology blogs in the UK. With my dedication to technology and drive to share my insights, I aim to continue providing my readers with engaging and informative content.
