Architecture & Design

31 Oct

Distill Your LLMs and Surpass Their Performance: spaCy’s Creator at InfoQ DevSummit Munich

stp2y0 CommentsNewsai, Architecture & Design, development, efficient mlops llm distillation, large language models, ML & Data Engineering, MLOps, Model Distillation

In her presentation at the inaugural edition of InfoQ Dev Summit Munich, Ines Montani built on top of the presentation she had earlier this year at QCon London and provided the audience with practical solutions for using the latest state-of-the-art models in real-world applications and distilling their knowledge into smaller and faster components that you can run and maintain in-house. She began by stating that using black box models hidden behind APIs would prevent us from satisfying the properties of good software: modular, transparent, explainable, data-private, reliable, and affordable. Further, Montani pointed out that GenAI can be helpful in multiple situations…

24 May

Ines Montani at QCon London: Economies of Scale Can’t Monopolise the AI Revolution

stp2y0 CommentsNewsai, ai revolution monopol, Architecture & Design, artificial intelligence, Automated Machine Learning, deep learning, development, generative ai, large language models, machine learning, ML & Data Engineering, QCon London 2024

During her presentation at QCon London, Ines Montani, co-founder and CEO of explosion.ai (the maker of spaCy), stated that economies of scale are not enough to create monopolies in the AI space and that open-source techniques and models will allow everybody to keep up with the "Gen AI revolution". Montani opened her presentation by asking for a show of hands to identify the open-source users in the audience. The vast majority of the audience raised their hand, easily demonstrating that open-source is ubiquitous ("it would be easier to ask who doesn’t use open-source’"). She pointed out the multiple benefits of the…