An artificial intelligence chatbot launched by the New York City government to help business owners get relevant information has been spreading false information and sometimes misleading users about illegal activities, according to a report from the city government. . This report was co-published with local nonprofit newsrooms record on file and Cityincluding numerous examples of chatbots providing inaccurate answers to questions related to housing policy, workers’ rights, and other topics.
Mayor Adams’ administration in October complemented the MyCity portal as a “one-stop shop for city services and benefits.” Powered by Microsoft’s Azure AI, the chatbot is aimed at current and aspiring business owners and is promoted as a source of “actionable and trustworthy information” directly from the city government’s website. But it’s just a pilot program, and a disclaimer on the site notes that it “may occasionally produce content that is incorrect, harmful, or biased.”
exist markDuring testing, the chatbot repeatedly provided incorrect information. For example, in response to the question “Can I make my store cashless?” it responded: “Yes, you can make your store in New York City cashless” — even though New York City in 2020 Cashless shops are banned. Chatbots also incorrectly answered questions about whether employers can accept tips from workers, whether landlords must accept Section 8 vouchers or rent assistance from tenants, and whether businesses must notify employees of schedule changes, reports show.An interview with a housing policy expert mark Calling the chatbot “highly inaccurate” at worst.
The city said the chatbot is still in development.in a statement markLeslie Brown, a spokesperson for the New York City Office of Technology and Innovation, said the chatbot “has provided timely, accurate answers to thousands of people,” but added, “We will continue to focus on upgrading this tool so that we can Better support small businesses across the city.”
