{"id":577,"date":"2025-01-03T03:27:47","date_gmt":"2025-01-03T03:27:47","guid":{"rendered":"https:\/\/www.batteryone.co\/blog\/?p=577"},"modified":"2025-01-03T03:27:47","modified_gmt":"2025-01-03T03:27:47","slug":"apples-new-visual-search-a-privacy-dilemma-you-didnt-ask-for","status":"publish","type":"post","link":"https:\/\/www.batteryone.co\/blog\/archives\/577","title":{"rendered":"Apple\u2019s New Visual Search: A Privacy Dilemma You Didn\u2019t Ask For"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n

Apple<\/a>‘s recent updates through Apple Intelligence<\/strong> have significantly improved the camera and image features on iPhones, such as generating movies from your photos and offering generative image editing. One of the most exciting features for many users is natural language search<\/strong>, which lets you find photos simply by describing them in plain language.<\/p>\n\n\n\n

However, a blog post by developer Jeff Johnson has revealed serious privacy concerns regarding this feature, designed to make it easier to search for landmarks and points of interest. Many iPhone<\/a> users have already updated to iOS 18 without fully understanding that a feature called Enhanced Visual<\/strong> Search<\/em> is now built into their devices.<\/p>\n\n\n\n

How Enhanced Visual Search Works<\/h2>\n\n\n\n

This feature works by detecting a point of interest within a photo. A commonly cited example is the Eiffel Tower. On-device artificial intelligence (AI) creates a mathematical “fingerprint”<\/strong> of the specific area of the image, referred to by Apple as a \u201cvector embedding.\u201d<\/strong> This vector is then sent to Apple\u2019s servers for further processing, with a privacy layer in place that includes fake queries to prevent the server from identifying the real ones. In return, Apple’s servers send back encrypted potential matches.<\/p>\n\n\n\n

The Privacy Issue<\/h2>\n\n\n\n

While Apple claims that the process protects users’ privacy, Johnson argues that this behavior constitutes a privacy violation. He explains in his blog, “I never requested that my on-device experiences be \u2018enriched\u2019 by phoning home to Cupertino\u2026 If something happens entirely on my device, it\u2019s private. But if my device sends data to the manufacturer, then it\u2019s not entirely private.”<\/p>\n\n\n\n

The Enhanced Visual Search<\/em> feature debuted as part of iOS 18 and macOS 15 on September 16, 2024. However, Apple\u2019s initial announcements about these releases mentioned only \u201cnatural language queries\u201d and an \u201cexpanded understanding\u201d of search, without clarifying that photo data would be sent to Apple’s servers by default.<\/p>\n\n\n\n

On October 24th, Apple did provide a brief explanation about the feature in a technical document discussing machine learning and homomorphic encryption. This document mentioned Enhanced Visual Search<\/strong><\/em> and its role in identifying landmarks or points of interest. Additionally, Apple released a legal document detailing more privacy information. However, most users are unaware of these documents, and even fewer understand their implications.<\/p>\n\n\n\n

A Silent Privacy Shift<\/h2>\n\n\n\n

Apple\u2019s new feature might improve search functionality, but the lack of transparency regarding data transmission raises valid privacy concerns. Many users have unknowingly opted into sharing their photos with Apple\u2019s servers as part of the Enhanced Visual Search<\/em> experience. As this feature continues to roll out, it\u2019s crucial for users to stay informed and consider the potential privacy trade-offs involved.<\/p>\n","protected":false},"excerpt":{"rendered":"

Apple‘s recent updates through Apple Intelligence have significantly improved the camera and image features on iPhones, such as generating movies from your photos and offering generative image editing. One of the most exciting features for many users is natural language search, which lets you find photos simply by describing them in plain language. However, a blog post by […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[7],"class_list":["post-577","post","type-post","status-publish","format-standard","hentry","category-news","tag-apple"],"_links":{"self":[{"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/posts\/577","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/comments?post=577"}],"version-history":[{"count":1,"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/posts\/577\/revisions"}],"predecessor-version":[{"id":579,"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/posts\/577\/revisions\/579"}],"wp:attachment":[{"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/media?parent=577"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/categories?post=577"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.batteryone.co\/blog\/wp-json\/wp\/v2\/tags?post=577"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}