Dive deeper into the world of AI innovation and stay ahead of the AI curve! Subscribe to our AI_Distilled newsletter for the latest insights. Don't miss out – sign up today! 👋 Hello , Welcome back to a new issue of AI_Distilled - your guide to the key advancements in AI, ML, NLP, and GenAI. Let's dive right into an industry expert’s perspective to sharpen our understanding of the field's rapid evolution. "In the near future, anyone who's online will be able to have a personal assistant powered by artificial intelligence that's far beyond today's technology." In a recent interview, Gates minced no words when he said software is still “pretty dumb” even in today’s day and age. The next 5 years will be crucial, he believes, as everything we know about computing in our personal and professional lives is on the brink of a massive disruption. Even everyday things as simple as phone calls are due for transformation as evident from Samsung unveiling the new 'Galaxy AI' and real-time translate call feature. In this issue, we’ll talk about Google exploring massive investment in AI startup Character.AI, Microsoft's GitHub Copilot user base surging to over a million, OpenAI launching data partnerships to enhance AI understanding, and Adobe researchers’ breakthrough AI that transforms 2D images into 3D models in 5 seconds. We’ve also got you your fresh dose of AI secret knowledge and tutorials. Explore how to scale multimodal understanding to long videos, navigate the landscape of hallucinations in LLMs, read a practical guide to enhancing RAG system responses, how to generate Synthetic Data for Machine Learning and unlock the power of low-code GPT AI apps. | |
📥 Feedback on the Weekly Edition We've hit 6 months and 38K subscribers in our AI_Distilled newsletter journey — thanks to you! The best part? Our emails are opened by 60% of recipients each week. We're dedicated to tailoring them to enhance your Data & AI practice. Let's work together to ensure they fully support your AI efforts and make a positive impact on your daily work. Share your thoughts in a quick 5-minute survey to shape our content. As a big thanks, get our bestselling "The Applied Artificial Intelligence Workshop" in PDF. Let's make AI_Distilled even more awesome! 🚀 | |
Writer’s Credit: Special shout-out to Vidhu Jain for their valuable contribution to this week’s newsletter content! Cheers, Merlyn Shelley Editor-in-Chief, Packt | |
⚡ TechWave: AI/GPT News & Analysis | |
🔳 Google Explores Massive Investment in AI Startup Character.AI: Google is reportedly in discussions to invest 'hundreds of millions' in Character.AI, an AI chatbot startup founded by ex-Google Brain employees. The investment is expected to deepen the collaboration between the two entities, leveraging Google's cloud services and Tensor Processing Units (TPUs) for model training. Character.AI, offering virtual interactions with celebrities and customizable chatbots, targets a youthful audience, particularly those aged 18 to 24, constituting 60% of its web traffic. 🔳 AI Actions Empowers AI Platforms with Zapier Integration: AI Actions introduces a tool enabling AI platforms to seamlessly run any Zapier action, leveraging Zapier's extensive repository of 20,000+ searches and actions. The integration allows natural language commands to trigger Zapier actions, eliminating obstacles like third-party app authentication and API integrations. Supported on platforms like ChatGPT, GPTs, Zapier, and customizable solutions, AI Actions provides flexibility for diverse applications. 🔳 Samsung Unveils 'Galaxy AI' and Real-Time Translate Call Feature: Samsung declares its commitment to AI with a preview of "Galaxy AI," a comprehensive mobile AI experience that combines on-device AI with cloud-based AI collaborations. The company introduced an upcoming feature, "AI Live Translate Call," embedded in its native phone app, offering real-time audio and text translations on the device during calls. Set to launch early next year, Galaxy AI is anticipated to debut with the Galaxy S24 lineup. 🔳 Google Expands Collaboration with Anthropic, Prioritizing AI Security and Cloud TPU v5e Accelerators: In an intensified partnership, Google announces its extended collaboration with Anthropic, focusing on elevated AI security and leveraging Cloud TPU v5e chips for AI inference. The collaboration, dating back to Anthropic's inception in 2021, highlights their joint efforts in AI safety and research. Anthropic, utilizing Google's Cloud services like GKE clusters, AlloyDB, and BigQuery, commits to Google Cloud's security services for model deployment. 🔳 Microsoft's GitHub Copilot User Base Surges to Over a Million, CEO Nadella Reports: Satya Nadella announced a substantial 40% growth in paying customers for GitHub Copilot in the September quarter, surpassing one million users across 37,000 organizations. Nadella highlights the rapid adoption of Copilot Chat, utilized by companies like Shopify, Maersk, and PWC, enhancing developers' productivity. The Bing search engine, integrated with OpenAI's ChatGPT, has facilitated over 1.9 billion chats, demonstrating a growing interest in AI-driven interactions. Microsoft's Azure revenue, including a significant contribution from AI services, exceeded expectations, reaching $24.3 billion, with the Azure business rising by 29%. 🔳 Dell and Hugging Face Join Forces to Streamline LLM Deployment: Dell and Hugging Face unveil a strategic partnership aimed at simplifying the deployment of LLMs for enterprises. With the burgeoning interest in generative AI, the collaboration seeks to address common concerns such as complexity, security, and privacy. The companies plan to establish a Dell portal on the Hugging Face platform, offering custom containers, scripts, and technical documentation for deploying open-source models on Dell servers. 🔳 OpenAI Launches Data Partnerships to Enhance AI Understanding: OpenAI introduces Data Partnerships, inviting collaborations with organizations to develop both public and private datasets for training AI models. The initiative aims to create comprehensive datasets reflecting diverse subject matters, industries, cultures, and languages, enhancing AI's understanding of the world. Two partnership options are available: Open-Source Archive for public datasets and Private Datasets for proprietary AI models, ensuring sensitivity and access controls based on partners' preferences. 🔳 Iterate Unveils AppCoder LLM for Effortless AI App Development: California-based Iterate introduces AppCoder LLM, a groundbreaking model embedded in the Interplay application development platform. This innovation allows enterprises to generate functional code for AI applications effortlessly by issuing natural language prompts. Unlike existing AI-driven coding solutions, AppCoder LLM, integrated into Iterate's platform, outperforms competitors, producing better outputs in terms of functional correctness and usefulness. 🔳 Adobe Researchers Unveil Breakthrough AI: Transform 2D Images into 3D Models in 5 Seconds: A collaborative effort between Adobe Research and Australian National University has resulted in a groundbreaking AI model capable of converting a single 2D image into a high-quality 3D model within a mere 5 seconds. The Large Reconstruction Model for Single Image to 3D (LRM) utilizes a transformer-based neural network architecture with over 500 million parameters, trained on approximately 1 million 3D objects. This innovation holds vast potential for industries like gaming, animation, industrial design, AR, and VR. | |
🔮 Expert Insights from Packt Community | |
Synthetic Data for Machine Learning - By Abdulrahman Kerim Training ML models Developing an ML model usually requires performing the following essential steps: Collecting data. Annotating data. Designing an ML model. Training the model. Testing the model. These steps are depicted in the following diagram: | |
Fig – Developing an ML model process. Now, let’s look at each of the steps in more detail to better understand how we can develop an ML model. Collecting and annotating data The first step in the process of developing an ML model is collecting the needed training data. You need to decide what training data is needed: Train using an existing dataset: In this case, there’s no need to collect training data. Thus, you can skip collecting and annotating data. However, you should make sure that your target task or domain is quite similar to the available dataset(s) you are planning to deploy. Otherwise, your model may train well on this dataset, but it will not perform well when tested on the new task or domain. Train on an existing dataset and fine-tune on a new dataset: This is the most popular case in today’s ML. You can pre-train your model on a large existing dataset and then fine-tune it on the new dataset. Regarding the new dataset, it does not need to be very large as you are already leveraging other existing dataset(s). For the dataset to be collected, you need to identify what the model needs to learn and how you are planning to implement this. After collecting the training data, you will begin the annotation process. Train from scratch on new data: In some contexts, your task or domain may be far from any available datasets. Thus, you will need to collect large-scale data. Collecting large-scale datasets is not simple. To do this, you need to identify what the model will learn and how you want it to do that. Making any modifications to the plan later may require you to recollect more data or even start the data collection process again from scratch. Following this, you need to decide what ground truth to extract, the budget, and the quality you want. This content is from the book “Synthetic Data for Machine Learning” written by Abdulrahman Kerim (Oct 2023). Start reading a free chapter or access the entire Packt digital library free for 7 days by signing up now. To learn more, click on the button below. | |
🌟 Secret Knowledge: AI/LLM Resources | |
🤖 Scaling Multimodal Understanding to Long Videos: A Comprehensive Guide: This guide provides a step-by-step explanation of the challenges associated with modeling diverse modalities like video, audio, and text. Learn about the Mirasol3B architecture, which efficiently handles longer videos, and understand the coordination between time-aligned and contextual modalities. The guide also introduces the Combiner, a learning module to effectively combine signals from video and audio information. 🤖 Mastering AI and ML Workloads: A Guide with Cloud HPC Toolkit: This post, authored by Google Cloud experts, delves into the convergence of HPC systems with AI and ML, highlighting their mutual benefits. They provide instructions on deploying clusters, utilizing preconfigured partitions, and utilizing powerful tools such as enroot and Pyxis for container integration. Discover the simplicity of deploying AI models on Google Cloud with the Cloud HPC Toolkit, fostering innovation and collaboration between HPC and AI communities. 🤖 Navigating the Landscape of Hallucinations in LLMs: A Comprehensive Exploration: Delve into the intricate world of LLMs and the challenges posed by hallucinations in this in-depth blog post. Gain an understanding of the various types of hallucinations, ranging from harmless inaccuracies to potentially harmful fabrications, and their implications in real-world applications. Explore the root factors leading to hallucinations, such as overconfidence and lack of grounded reasoning, during LLM training. 🤖 Unveiling the Core Challenge in GenAI: Cornell University's Insightful Revelation: Cornell University researchers unveil a pivotal threat in GenAI, emphasizing the crucial role of "long-term memory" and the need for a vector database for contextual retrieval. Privacy issues emerge in seemingly secure solutions, shedding light on the complex challenges of handling non-numerical data in advanced AI models. | |
🔛 Masterclass: AI/LLM Tutorials | |
👉 Unlocking the Power of Low-Code GPT AI Apps: A Comprehensive Guide. Explore how AINIRO.IO introduces the concept of "AI Apps" by seamlessly integrating ChatGPT with CRUD operations, enabling natural language interfaces to databases. Dive into the intricacies of creating a dynamic AI-based application without extensive coding, leveraging the Magic cloudlet to generate CRUD APIs effortlessly. Explore the significant implications of using ChatGPT for business logic in apps, offering endless possibilities for user interactions. 👉 Deploying LLMs Made Easy with ezsmdeploy 2.0 SDK: This post provides an in-depth understanding of the new capabilities, allowing users to effortlessly deploy foundation models like Llama 2, Falcon, and Stable Diffusion with just a few lines of code. The SDK automates instance selection, configuration of autoscaling, and other deployment details, streamlining the process of launching production-ready APIs. Whether deploying models from Hugging Face Hub or SageMaker Jumpstart, ezsmdeploy 2.0 reduces the coding effort required to integrate state-of-the-art models into production, making it a valuable tool for data scientists and developers. 👉 Enhancing RAG System Responses: A Practical Guide: Discover how to enhance the performance of your Retrieval-Augmented Generation (RAG) systems in generative AI applications by incorporating an interactive clarification component. This post offers a step-by-step guide on improving the quality of answers in RAG use cases where users present vague or ambiguous queries. Learn how to implement a solution using LangChain to engage in a conversational dialogue with users, prompting them for additional details to refine the context and provide accurate responses. 👉 Building Personalized ChatGPT: A Step-by-Step Guide. In this post, you'll learn how to explore OpenAI's GPT Builder, offering a beginner-friendly approach to customize ChatGPT for various applications. With the latest GPT update, users can now create personalized ChatGPT versions, even without technical expertise. The tutorial focuses on creating a customized GPT named 'EduBuddy,' designed to enhance the educational journey with tailored learning strategies and interactive features. | |
🚀 HackHub: Trending AI Tools | |
💮 reworkd/tarsier: Open-source utility library for multimodal web agents, facilitating interaction with GPT-4(V) by visually tagging interactable elements on a page. 💮 recursal/ai-town-rwkv-proxy: Allows developers to locally run a large AI town using the RWKV model, a linear transformer with low inference costs. 💮 shiyoung77/ovir-3d: Enables open-vocabulary 3D instance retrieval without training on 3D data, addressing the challenge of obtaining diverse annotated 3D categories. 💮 langroid/langroid: User-friendly Python framework for building LLM-powered applications through a Multi-Agent paradigm. 💮 punica-ai/punica: Framework for Low Rank Adaptation (LoRA) to incorporate new knowledge into a pretrained LLM with minimal storage and memory impact. |