{"id":630652,"date":"2024-12-05T08:15:21","date_gmt":"2024-12-05T13:15:21","guid":{"rendered":"https:\/\/www.rochester.edu\/newscenter\/?p=630652"},"modified":"2024-12-05T08:15:21","modified_gmt":"2024-12-05T13:15:21","slug":"voice-changer-in-real-time-anonymizer-software-630652","status":"publish","type":"post","link":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/","title":{"rendered":"Researchers developing tool to instantly conceal and anonymize voices"},"content":{"rendered":"

The voice-changer system will produce computer-generated speech within milliseconds, allowing users to control factors like age, gender, and dialect.<\/h2>\n

Researchers are developing a new system that will allow people to speak anonymously in real time through computer-generated voices to help protect privacy and avoid censorship or retaliation. The technology is intended to help people such as intelligence officers carrying out sensitive missions, crime witnesses concerned about being identified by perpetrators, and whistleblowers who fear retaliation.<\/p>\n

The three-year project, led by Honeywell and including collaborators from the Ä¢¹½´«Ã½<\/a>, Texas A&M, and the University of Texas at Dallas, is funded by the Intelligence Advanced Research Projects Activity (IARPA) and part of the Anonymous Real-Time Speech (ARTS) program<\/a>.<\/p>\n

The voice-changer project has three main objectives. First, the system will transform what a user says into a digital voice within a few milliseconds, ensuring that it can be used in real-time conversations. Second, the team aims to allow users to specify what they call static traits, allowing control over the digital voice\u2019s age, gender, and dialect. Lastly, they want to neutralize what they call dynamic traits, such as emotions or health status that could potentially tip the identity of the user.<\/p>\n

\u201cIn the end, a 30-year-old woman from Texas will be able to instantaneously transform her voice to be output by the virtual speaker to sound like a 50-year-old man with a British accent, for example, without producing artifacts that can be traced back to the identity of the user,\u201d says Zhiyao Duan<\/a>, an associate professor of electrical and computer engineering<\/a> and Rochester\u2019s lead on the project. \u201cAnd in addition to the latency requirements, we\u2019ll also be working to ensure the intelligibility and naturalness of the computer-generated voice.\u201d<\/p>\n

Duan says that while the roles on the project are fluid, his team at Rochester will initially focus on generating the virtual speakers and controls for the static traits, building on their experience in speaker modeling, disentangled speech representations, and voice synthesis. The team will first develop the technology to work in English. If successful, they plan to expand it to other languages such as Spanish, Mandarin, and Korean.<\/p>\n

The team hopes these open-source voice-changer tools will have positive benefits far beyond the intended initial use cases. Still, the researchers recognize that people may have concerns about such powerful software.<\/p>\n

\u201cI think it\u2019s natural for people to wonder what will happen if these tools get in the hands of bad actors,\u201d says Duan. \u201cIt\u2019s important to note that my lab and others around the globe are also working to develop deepfake detection tools so that people can discern whether something is said by an actual person or generated through algorithms. Those tools will be equally important to have.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"

The voice-changer system will produce computer-generated speech within milliseconds, allowing users to control factors like age, gender, and dialect.<\/p>\n","protected":false},"author":1242,"featured_media":630682,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[116],"tags":[19382,18632,9186,30532],"class_list":["post-630652","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sci-tech","tag-department-of-electrical-and-computer-engineering","tag-hajim-school-of-engineering-and-applied-sciences","tag-research-funding","tag-zhiyao-duan"],"acf":[],"yoast_head":"\nResearchers developing tool to instantly conceal and anonymize voices<\/title>\n<meta name=\"description\" content=\"The voice-changer system will produce computer-generated speech within milliseconds while controlling factors like age, gender, and dialect.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Researchers developing tool to instantly conceal and anonymize voices\" \/>\n<meta property=\"og:description\" content=\"The voice-changer system will produce computer-generated speech within milliseconds while controlling factors like age, gender, and dialect.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/\" \/>\n<meta property=\"og:site_name\" content=\"News Center\" \/>\n<meta property=\"article:published_time\" content=\"2024-12-05T13:15:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2024\/12\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"600\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/gif\" \/>\n<meta name=\"author\" content=\"Luke Auburn\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Luke Auburn\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/\"},\"author\":{\"name\":\"Luke Auburn\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#\\\/schema\\\/person\\\/e928dc2863b53a89ece6d40c7992a4e1\"},\"headline\":\"Researchers developing tool to instantly conceal and anonymize voices\",\"datePublished\":\"2024-12-05T13:15:21+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/\"},\"wordCount\":470,\"image\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif\",\"keywords\":[\"Department of Electrical and Computer Engineering\",\"Hajim School of Engineering and Applied Sciences\",\"research funding\",\"Zhiyao Duan\"],\"articleSection\":[\"Science & Technology\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/\",\"name\":\"Researchers developing tool to instantly conceal and anonymize voices\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif\",\"datePublished\":\"2024-12-05T13:15:21+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#\\\/schema\\\/person\\\/e928dc2863b53a89ece6d40c7992a4e1\"},\"description\":\"The voice-changer system will produce computer-generated speech within milliseconds while controlling factors like age, gender, and dialect.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif\",\"contentUrl\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif\",\"width\":1000,\"height\":600,\"caption\":\"VOICE MAKEOVERS: Real-time voice-changer technology could help intelligence officers, witnesses to crimes, and whistleblowers protect their identities. (Ä¢¹½´«Ã½ GIF \\\/ AJ Pow)\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/voice-changer-in-real-time-anonymizer-software-630652\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Researchers developing tool to instantly conceal and anonymize voices\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#website\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/\",\"name\":\"News Center\",\"description\":\"Ä¢¹½´«Ã½\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/#\\\/schema\\\/person\\\/e928dc2863b53a89ece6d40c7992a4e1\",\"name\":\"Luke Auburn\",\"url\":\"https:\\\/\\\/www.rochester.edu\\\/newscenter\\\/author\\\/lauburn\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Researchers developing tool to instantly conceal and anonymize voices","description":"The voice-changer system will produce computer-generated speech within milliseconds while controlling factors like age, gender, and dialect.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/","og_locale":"en_US","og_type":"article","og_title":"Researchers developing tool to instantly conceal and anonymize voices","og_description":"The voice-changer system will produce computer-generated speech within milliseconds while controlling factors like age, gender, and dialect.","og_url":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/","og_site_name":"News Center","article_published_time":"2024-12-05T13:15:21+00:00","og_image":[{"url":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2024\/12\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif","width":1000,"height":600,"type":"image\/gif"}],"author":"Luke Auburn","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Luke Auburn","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/#article","isPartOf":{"@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/"},"author":{"name":"Luke Auburn","@id":"https:\/\/www.rochester.edu\/newscenter\/#\/schema\/person\/e928dc2863b53a89ece6d40c7992a4e1"},"headline":"Researchers developing tool to instantly conceal and anonymize voices","datePublished":"2024-12-05T13:15:21+00:00","mainEntityOfPage":{"@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/"},"wordCount":470,"image":{"@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/#primaryimage"},"thumbnailUrl":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2024\/12\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif","keywords":["Department of Electrical and Computer Engineering","Hajim School of Engineering and Applied Sciences","research funding","Zhiyao Duan"],"articleSection":["Science & Technology"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/","url":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/","name":"Researchers developing tool to instantly conceal and anonymize voices","isPartOf":{"@id":"https:\/\/www.rochester.edu\/newscenter\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/#primaryimage"},"image":{"@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/#primaryimage"},"thumbnailUrl":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2024\/12\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif","datePublished":"2024-12-05T13:15:21+00:00","author":{"@id":"https:\/\/www.rochester.edu\/newscenter\/#\/schema\/person\/e928dc2863b53a89ece6d40c7992a4e1"},"description":"The voice-changer system will produce computer-generated speech within milliseconds while controlling factors like age, gender, and dialect.","breadcrumb":{"@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/#primaryimage","url":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2024\/12\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif","contentUrl":"https:\/\/www.rochester.edu\/newscenter\/wp-content\/uploads\/2024\/12\/fea-instant-voice-changer-technology-ZhiyaoDuanGID_08_o.gif","width":1000,"height":600,"caption":"VOICE MAKEOVERS: Real-time voice-changer technology could help intelligence officers, witnesses to crimes, and whistleblowers protect their identities. (Ä¢¹½´«Ã½ GIF \/ AJ Pow)"},{"@type":"BreadcrumbList","@id":"https:\/\/www.rochester.edu\/newscenter\/voice-changer-in-real-time-anonymizer-software-630652\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.rochester.edu\/newscenter\/"},{"@type":"ListItem","position":2,"name":"Researchers developing tool to instantly conceal and anonymize voices"}]},{"@type":"WebSite","@id":"https:\/\/www.rochester.edu\/newscenter\/#website","url":"https:\/\/www.rochester.edu\/newscenter\/","name":"News Center","description":"Ä¢¹½´«Ã½","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.rochester.edu\/newscenter\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.rochester.edu\/newscenter\/#\/schema\/person\/e928dc2863b53a89ece6d40c7992a4e1","name":"Luke Auburn","url":"https:\/\/www.rochester.edu\/newscenter\/author\/lauburn\/"}]}},"_links":{"self":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts\/630652","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/users\/1242"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/comments?post=630652"}],"version-history":[{"count":4,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts\/630652\/revisions"}],"predecessor-version":[{"id":630692,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/posts\/630652\/revisions\/630692"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/media\/630682"}],"wp:attachment":[{"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/media?parent=630652"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/categories?post=630652"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rochester.edu\/newscenter\/wp-json\/wp\/v2\/tags?post=630652"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}