Llama Unleashed: How Llama3 is Spitting Image of AI Innovation

Matteo Cappelloni
3 min readApr 28, 2024

--

Llama3’s Rapid Expansion and Market Disruption

Just ten days post its release, llama3 has already marked its territory in the AI landscape. Spearheaded by innovations from Wing lian and Gradient AI, the model’s context size has been pushed beyond 256k, showcasing its expansive potential.

Llama3’s introduction has catalyzed the development of a plethora of fine-tuned models, covering a wide array from DPO and RLHF to function calling and specialized medical assistants, largely influenced by Eric Hartford’s work with the Dolphin uncensored dataset. Notably, llama3’s disruption of the English AI API market is underscored by its speed on Groq hardware and its cost-effectiveness, making it a formidable player in the rapidly evolving sector.

Phi3-Mini’s Limited Utility Amid Anticipation for Larger Models

The release of phi3-mini has stirred considerable excitement within the AI community, primarily due to its impressive performance on evaluations tailored to Rag and agentic tasks. However, the reality paints a slightly different picture; its efficacy seems confined to these specific areas. The AI sphere is abuzz with anticipation for the upcoming medium and large versions of phi3, which promise groundbreaking capabilities.

As of now, phi3-mini serves as a promising preview, setting high expectations for its successors, which are expected to expand the model’s utility across a broader range of tasks, making it a more versatile tool in the artificial intelligence arsenal.

Biomedical AI’s Leap Forward with New Models

The biomedical sector has witnessed a significant advancement with the release of three new biomed large language models (LLMs) this week: internistAI 7B, OpenBioLLM-llama3, and Apollo. These models, developed by pioneers like Aaditya Ura and organizations such as Freedom Intelligence on Hugging Face, are set to revolutionize the medical field with their specialized capabilities.

The emergence of these tools is not just a technical evolution; it represents a disruptive force likely to transform healthcare diagnostics, treatment planning, and patient management, heralding a new era in biomed AI.

The Political Dynamics of AI Safety and Security

The Department of Homeland Security’s recent announcement about the formation of the Artificial Intelligence Safety and Security Board has been met with mixed reactions. The board, featuring tech luminaries such as Sam Altman and Sundar Pichai, notably excludes influential figures like Elon Musk and entities like Meta, hinting at underlying political motivations.

This move has sparked discussions about the influence of big corporations on regulatory frameworks and the marginalization of open-source AI initiatives, as evidenced by Yann LeCun’s remarks about being overlooked. This development highlights the complex interplay between politics and technological governance.

The Convergence of Robotics and AI

The intersection of robotics and artificial intelligence is evolving at an unprecedented pace, marked by increasingly sophisticated robotic movements and substantial investments in the sector. Every day, robotics inches closer to achieving seamless human-robot interactions, a testament to the relentless progress and the synergistic integration of AI technologies.

This trend not only showcases the technological marvels being developed but also sets the stage for future innovations that could redefine our interaction with machines in everyday scenarios.

The Mixed Fortunes of the AI Gadget Market

Despite the burgeoning interest and continued investment in the AI gadget market, consumer traction remains tepid for products like the Humane pin and Rabbit R1. Meanwhile, AR/VR technologies are slowly progressing; Meta’s collaboration with RayBan introduces a tech-enthusiast AR eyewear, and upcoming MetaQuest models hint at improvements. On the other hand, Apple’s Vision Pro positions itself as a premium offering, yet its bulkiness remains a barrier.

This segment, though brimming with potential, illustrates the challenges of marrying cutting-edge technology with consumer-friendly design and usability.

Conclusion: The Shadow of Big Corporate on AI Regulation

The recent developments in AI regulation and the establishment of oversight bodies are increasingly perceived as maneuvers heavily influenced by major corporations, to the detriment of open-source initiatives.

This skepticism is fueled by the exclusion of significant players such as Elon Musk and Meta from pivotal discussions and platforms like the AI Safety and Security Board. Such moves underscore a broader pessimism about the role of big tech in shaping the future of AI governance, where commercial interests might overshadow the inclusive and open development of AI technologies.

The challenge remains to balance these influences in a way that promotes innovation while ensuring ethical standards and widespread benefits.

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

--

--

Written by Matteo Cappelloni

Nerd, Typescript, Kubernetes, Ai and Games. CTO @ nextadv.it

No responses yet

Write a response