Tag: on-device AI

  • Apple Intelligence Update Empowers SmartGym and VLLO Features

    Apple Intelligence Update Empowers SmartGym and VLLO Features

    Key Takeaways

    1. Apple introduced the Foundation Models framework as part of Apple Intelligence, enabling developers to use large language models directly on devices.
    2. The framework emphasizes user privacy and offline functionality, with inference done at no cost to reduce server dependency.
    3. Early feedback from developers highlights impressive use cases, such as journaling prompts in Stoic and scientific explanations in CellWalk.
    4. The framework supports various app categories, including health (SmartGym), education (CellWalk), and productivity tools (Stuff, VLLO).
    5. Foundation Models is integrated with Swift and offers beta support for nine languages, including English, French, and Japanese.

    Apple has introduced its Foundation Models framework, which is an essential component of Apple Intelligence, alongside the launch of iOS 26, iPadOS 26, and macOS 26 this month. The company claims that this framework allows developers to incorporate large language models directly on devices, opening up new functionalities while maintaining user privacy and ensuring that apps can work offline. Furthermore, Apple mentions that inference is done at no cost, minimizing the reliance on server infrastructure.

    Adoption and Feedback

    Susan Prescott, who is Apple’s vice president of Worldwide Developer Relations, mentioned that early uptake has been impressive. “From creating journaling prompts that ignite creativity in Stoic, to providing conversational explanations of scientific terms in CellWalk, it’s amazing to witness the new powerful capabilities that are already improving the applications people utilize each day,” she stated.

    Examples Across Categories

    Apple showcased various examples spanning different app categories. In the health and fitness realm, SmartGym supposedly allows users to articulate their workouts in everyday language, transforming them into structured routines, while Stoic offers journaling prompts based on recent entries, all processed on the device. Other applications such as SwingVision, 7 Minute Workout, Gratitude, and Train Fitness are reportedly offering personalized coaching and summaries through this framework.

    Educational and Creative Applications

    Educational apps like CellWalk, Grammo, and Platzi are said to give conversational explanations of scientific or grammatical concepts, generate new practice questions, or respond to lesson-specific inquiries. Additionally, productivity and creative tools such as Stuff and VLLO are claimed to take advantage of task automation and video editing suggestions that are powered by Apple Intelligence.

    Apple asserts that the Foundation Models framework is closely integrated with Swift, offering guided generation and tool calling. It is currently available on devices compatible with Apple Intelligence, with beta support for nine languages, which include English, French, German, Japanese, and simplified Chinese.

    Source:
    Link

    Apple Intelligence Update Empowers SmartGym and VLLO Features

     

    Tags: ,
  • Apple to Double iPhone RAM for On-Device AI in 2025 Rumor

    Apple to Double iPhone RAM for On-Device AI in 2025 Rumor

    Apple is poised to unveil the iPhone 16 lineup on September 9, but anticipation for the iPhone 17 series is already growing.

    The iPhones slated for release in 2025 are rumored to introduce significant changes, including the debut of a new iPhone 17 Slim and the inclusion of ProMotion 120Hz support across all models.

    A recent leak from China has added another potential upgrade to the list: RAM capacity. The leak suggests that the iPhone 17 series will feature 12GB of RAM for every model.

    iPhone 17 Leak Details

    According to the leak, the iPhone 16 series is expected to have 8GB of RAM. In contrast, last year’s iPhone 15 Pro models were equipped with 8GB, while the standard versions had only 6GB. It appears that Apple is moving towards standardizing the RAM across its devices.

    The increased memory isn’t solely for enhancing performance, although it will certainly have that effect. The main reason is Apple’s developing strategy for on-device AI functionalities. Running AI directly on the device demands significant processing power and memory, which is where the additional RAM becomes essential.

    Google adopted a similar strategy with their Pixel 9 phones, where even basic models now come with 12GB of RAM. A portion of this memory is reserved for AI tasks handled on the device.

    Expectations for iPhone 16

    The iPhone 16 series is rumored to include AI or Apple Intelligence features that remain predominantly cloud-based. However, speculation indicates that the iPhone 17 will make a considerable shift towards on-device AI processing, necessitating the substantial RAM upgrade.

    While this leak is intriguing, it’s important to approach it with caution, as it originates from a less established source. The credibility of this information may increase if the iPhone 16 series indeed launches with 8GB of RAM, as the source suggests.

    Apple to Double iPhone RAM for On-Device AI in 2025 Rumor
    Tags: , ,
  • Samsung Starts Mass Production of New DRAM – Enhanced AI Processing

    Samsung Starts Mass Production of New DRAM – Enhanced AI Processing

    Samsung has announced that it has started mass production of the industry's thinnest 12-nanometer (nm) class, 12-gigabyte (GB), and 16GB LPDDR5X DRAM packages. This move is anticipated to reinforce Samsung's position as a leader in the low-power DRAM market.

    Samsung Starts Mass Production of New DRAM - Enhanced AI Processing

    Expanding Business in Low-Power DRAM Market

    The company plans to grow its presence in the low-power DRAM sector by providing these 0.65mm LPDDR5X DRAM packages to manufacturers of mobile processors and devices. Samsung has achieved the delivery of ultra-slim LPDDR5X DRAM packages, which can accommodate more capacity within a smaller volume. This innovation reportedly offers improved thermal control, a crucial factor for high-performance applications, such as on-device AI processing.

    Advancements in On-Device AI Processing

    Rumors suggest that Samsung is working on expanding its Galaxy AI capabilities beyond the S series flagships, aiming to introduce them to select A series devices starting this year. YongCheol Bae, Executive Vice President of Memory Product Planning at Samsung Electronics, stated, "Samsung’s LPDDR5X DRAM sets a new standard for high-performance on-device AI solutions, offering not only superior LPDDR performance but also advanced thermal management in an ultra-compact package."

    Technical Specifications and Improvements

    The new LPDDR5X DRAM packages from Samsung will feature the industry's thinnest 12 nm-class LPDDR DRAM in a 4-stack structure. The company claims this will reduce the thickness by approximately 9% and enhance heat resistance by about 21.2% compared to previous generations. The new LPDDR5X DRAM package is reportedly "as thin as a fingernail" at 0.65 millimeters, making it the thinnest among existing 12GB or above LPDDR DRAM. Samsung uses an 'optimized' back-lapping process, which involves grinding the backside of a wafer, to achieve this reduced thickness.

    Samsung remains dedicated to ongoing innovation through close collaboration with its customers, aiming to provide solutions that meet the future demands of the low-power DRAM market.

    Tags: ,
  • Honor Launches AI Eye Protection and Deepfake Detection

    Honor Launches AI Eye Protection and Deepfake Detection

    Honor has showcased its advancements in on-device AI at MWC Shanghai 2024, with a focus on user empowerment and safety. The company introduced two AI features: AI Defocus Eye Protection and AI Deepfake Detection.

    With the rise of nearsightedness due to prolonged screen time, Honor’s AI Defocus Eye Protection offers a unique solution. By simulating defocus glasses on the device’s display, this technology induces controlled defocus in peripheral vision, slowing down the eye elongation process linked to myopia. Early tests indicate an average 13-degree reduction in transient myopia after 25 minutes of reading, with some users experiencing up to 75 degrees reduction.

    AI Deepfake Detection

    On the other hand, Honor’s AI Deepfake Detection tackles the growing threat of manipulated content and online scams. The on-device feature scrutinizes factors like eye contact, lighting consistency, image clarity, and video playback for inconsistencies often undetectable by the human eye.

    This AI is trained on a vast dataset of videos and images associated with online scams. This allows it to identify, screen, and compare content in a mere three seconds! If synthetic or altered content is detected, a user receives an immediate risk warning, safeguarding them from potential scams.

    Commitment to On-Device AI

    Honor emphasizes its commitment to on-device AI, believing it to be the key to delivering personalized services while safeguarding user privacy. Unlike cloud-based AI, which relies on remote servers, on-device AI processes data directly on the smartphone, ensuring greater control and security for users.

    Honor’s CEO George Zhao envisions a future where on-device AI empowers users, seamlessly integrating into their lives and enhancing their capabilities. With AI Defocus Eye Protection and AI Deepfake Detection, Honor is taking significant steps towards this vision, demonstrating the transformative potential of human-centric AI.

    Honor Launches AI Eye Protection and Deepfake Detection
    Tags: , ,
  • ChatGPT on iPhone: Apple’s AI Push Demystified

    ChatGPT on iPhone: Apple’s AI Push Demystified

    Apple is on the verge of incorporating ChatGPT, an artificial intelligence tool developed by OpenAI, into iOS 18. Discussions between Apple and OpenAI have been progressing, although the specific details of this collaboration remain ambiguous. There are also indications that Apple might be in talks with Google (Gemini) regarding similar technological advancements. These speculations align with Apple's purported strategy of establishing an AI App Store, which would feature compact AI models on their devices while outsourcing larger ones. However, it is essential to note that these are merely speculations.

    Apple's Emphasis on On-Device AI Processing

    Apple has dedicated efforts towards advancing artificial intelligence, with the anticipation of making significant announcements at WWDC 2023. The forthcoming enhancements may include AI-driven browsing capabilities in Safari, an enhanced Siri experience, and the introduction of an on-device infrastructure for AI-powered conversations.

    Apple's recent emphasis on on-device AI processing was evident during a recent event. The company is also in the process of developing Ajax, an AI framework designed to manage tasks currently performed by Siri, such as text summarization and enhancing Spotlight searches. Additionally, there are rumors circulating about Apple introducing on-device technology to summarize voice notes.

    Apple's Distinct Approach to On-Device AI Processing

    Apple's strategic focus on on-device AI processing and responsible data handling practices, such as acquiring data access rather than resorting to data scraping, sets them apart from some of their competitors. This approach underscores Apple's commitment to user privacy and data security, aligning with their broader philosophy of ensuring a seamless and secure user experience.

    Tags: , ,
  • Apple Developing LLM for Advanced Gen AI Features on iPhone

    Apple Developing LLM for Advanced Gen AI Features on iPhone

    Apple's upcoming Worldwide Developer Conference (WWDC) is drawing closer, with expectations high for the unveiling of iOS 18, set to be a focal point of the event. Speculation abounds regarding the integration of advanced AI features into this new software iteration, as Apple aims to catch up with rivals in the realm of artificial intelligence. According to insights from Bloomberg's Mark Gurman, the tech giant is actively developing its own Large Language Model (LLM) to drive on-device AI capabilities for iPhones.

    Apple's In-House LLM Development

    An essential benefit of utilizing a Large Language Model (LLM) lies in its capacity to operate locally on the device, eliminating reliance on cloud services for task execution. This approach not only ensures data remains secure on the device but also enables quicker response times and enhanced privacy compared to cloud-based alternatives. Leveraging the processing power of iPhones, equipped with dedicated Neural Processing Units (NPUs), Apple's upcoming on-device AI features are poised to function effectively even with limited or no network connectivity.

    Integration with Key Applications

    Reports suggest that Apple's proprietary LLM, known by the codename Ajax, will be deeply integrated into core applications such as Health, Messages, and Shortcuts. This strategic integration aims to enhance user experience and streamline functionality across various Apple services.

    Potential Licensing Agreements

    While Apple's in-house LLM model is anticipated to offer robust on-device AI capabilities, there are indications that the company may explore partnerships or licensing agreements with third-party providers. Rumors suggest that Apple could consider licensing technologies like Google's Gemini AI to augment its offerings further. Such collaborations could potentially broaden the scope and capabilities of Apple's AI ecosystem, ensuring a comprehensive and competitive suite of features for iPhone users.

    Tags: , ,
  • Samsung Reveals First Galaxy S25 Detail: Enhanced AI Features

    Samsung Reveals First Galaxy S25 Detail: Enhanced AI Features

    The potential future of on-device AI for the upcoming Samsung Galaxy smartphones seems promising, with rumors pointing towards a continued partnership with Google and the forthcoming Gemini Nano 2 AI model.

    Collaboration with Google for Advanced AI

    Currently, the Galaxy S24 lineup utilizes the initial Gemini Nano for on-device functionalities. However, speculations suggest that the Galaxy S25, potentially launching in early 2025, could be the first to integrate the yet-to-be-revealed Gemini Nano 2.

    Insights from Samsung Executive Director

    A recent report from Daum Herald Economy, a South Korean platform, references statements made by Executive Director Cho Cheol-min from Samsung Electronics’ System LSI division. Cheol-min apparently discussed plans for the Galaxy S25 series, highlighting potential collaborations with Google and the utilization of Gemini Nano 2.

    Future Enhancements and Potential Subscription Model

    While specifics regarding how Gemini Nano 2 will enhance upon its predecessor remain undisclosed, anticipated improvements could encompass areas like voice recognition and image processing. Moreover, there are suggestions that forthcoming AI features may come with a subscription fee, as hinted by Samsung’s Mobile Experience CEO earlier this year.

    Awaited Developments and Ongoing Collaboration

    As the official launch of the Galaxy S25 series approaches, the exact enhancements that Google’s Gemini Nano 2 will bring to on-device AI are still uncertain. The possibility of an enduring partnership between Samsung and Google signals potential advancements in AI technology, although the precise outcomes of this collaboration remain to be seen.

    Tags: ,
  • First AI Core update released for Pixel 8 Pro

    First AI Core update released for Pixel 8 Pro

    Google Enhances On-Device AI Capabilities with Update to Pixel 8 Pro

    Google has released a unique update for the Google Pixel 8 Pro, focusing on enhancing the on-device AI capabilities. The update specifically targets the AI Core app, which powers the AI-driven functionalities directly on the device, eliminating the need for cloud servers and an internet connection.

    Update Details

    The recent update, which takes the AI Core app from version 0.release.539035001 to 0.release.582652206, is designed exclusively for the Pixel 8 Pro (codenamed “husky”). Pixel devices have included a placeholder for AI Core since the initial Android 14 update.

    Automatic Download

    If you own a Pixel 8 Pro, the update should have already been downloaded automatically onto your phone. While the average user may not directly interact with the AI Core app, it significantly enhances the overall user experience on the Pixel 8 Pro.

    Future Availability

    Currently, this update is reported to be exclusive to the Pixel 8 Pro. However, it is expected to make its way to the Pixel 8 and potentially older Pixel devices with Tensor chips in the near future.

    Potential Applications

    The update to the AI Core app brings several notable applications of the latest foundation models. These applications may include the implementation of features like ‘Zoom Enhance’ or making Magic Eraser work more swiftly. Samsung has also confirmed the addition of similar capabilities to its upcoming flagship, the Galaxy S24 series, referring to it as an ‘AI Phone.

    In conclusion, Google’s update to the AI Core app for the Pixel 8 Pro enhances the on-device AI capabilities and improves the user experience. While currently limited to the Pixel 8 Pro, it is expected to expand to other Pixel devices in the future. The update brings exciting potential applications, making the Pixel 8 Pro a powerful device for AI-driven functionalities.

    Tags: ,