News · AI Visibility · Johannesburg
We asked AI who can solve Johannesburg’s biggest local problems. Here’s what it answered.
On the eve of the 4 November vote, we tested how AI assistants answer residents’ everyday questions about water, safety, permits, waste and small-business support. Asked how to report a problem, the assistants mostly got it right. Asked who can fix it, 13 in 30 answers named a politician or a party.
JOHANNESBURG, 3 November 2026. Tomorrow, more than 29 million registered South Africans can vote in the local government elections. In Johannesburg, the questions on many voters’ minds are not abstract: why the taps ran dry, who collects the bins, where to report a pothole, how to get a building plan approved. With 75 parties contesting the city alone, there is no shortage of noise, and a growing number of residents are putting those questions to an AI assistant instead of a search engine.
So Johannesburg strategy and digital agency Ten 15 J.T. did the same. On 3 November, the team put 20 plain-language questions to six AI assistants and recorded every source each answer cited. Eight in 10 answers pointed residents to at least one official source, such as the City of Johannesburg or Johannesburg Water. But when a question did not mention Johannesburg, fewer than half of the answers dealt with Johannesburg first. The rest answered for Tshwane, Cape Town or the United States, gave a general answer, or asked where the person lived.
The audit asked factual questions only, such as where to report a water outage or how to apply for a trading permit. It did not ask which party or candidate to vote for, and Ten 15 J.T. takes no position on the election.
“Google taught us to fight for page one. AI has quietly removed the page,” says Janeth Thusi, Managing Director of Ten 15 J.T. “When a resident in Melville asks a chatbot where to report a burst pipe, there are no ten blue links to choose from. There is one answer. If the right organisation isn’t named in it, it may as well not exist for that person.”
Thusi calls this group the zero-click voter: someone who gets an answer, believes it, and never visits the source. The audit set out to see who those answers send them to.
What the AI assistants said| Issue | What we asked | Where a resident should be sent | What AI cited | The gap |
|---|---|---|---|---|
| Water | Where do I report an outage, and where do I get updates? | Johannesburg Water, via Joburg Connect and its WhatsApp update channel | All 24 answers named Johannesburg Water, most with the 0860 562 874 fault line | Two answers added a digit to the fault line. One sent residents to the City of Tshwane first |
| Safety | Who do I call for a robbery in progress, and who handles traffic? | SAPS 10111, JMPD | All six gave SAPS 10111; all six named JMPD for by-laws | One answered the traffic-light question for Tshwane only. One shortened the City’s emergency line to an unusable number |
| Permits | How do I get a building plan approved? | City of Johannesburg Development Planning | All six pointed to the City’s online plan system | On rezoning, three of six gave no Johannesburg answer, one leading with the United States |
| Waste | My bin hasn’t been collected. Who do I call? | Pikitup, via Joburg Connect | 17 of 24 answers named Pikitup | The weakest area: answers for Tshwane and Cape Town, two that asked for a location instead, and three wrong numbers |
| Small-business support | Where can my spaza shop get funding or a trading permit? | City of Johannesburg, Gauteng Enterprise Propeller, SEDFA | 23 of 24 named SEDFA, GEP, NEF or CIPC | Four answers listed SEDA or SEFA as separate agencies, two years after they merged into SEDFA |
Water and safety were answered best, with 47 of 48 answers naming the right body. Waste was answered worst. Six answers in all gave a wrong or mistyped phone number. On the five questions that asked “who can fix this?”, 8 of 30 answers named a political party and 13 named a party or a politician, rather than only the responsible institution. None of the 90 practical questions did. Nine answers used a party’s or a politician’s own website or social media page as a source.
“This is not really a technology story. It is an information-access story,” says Thusi. “The facts residents need are already published, by the City, by the IEC, by Johannesburg Water on WhatsApp. The question is whether they are published in a way machines can find, read and trust. Where they aren’t, the chatbot fills the gap with something else.”
Why being findable in AI answers now matters as much as ranking on GoogleOne in ten people across 48 markets now use AI chatbots for news every week, up from 7% a year earlier, according to the Reuters Institute’s Digital News Report 2026. Among 18 to 24-year-olds, the figure is 17%, and the report finds growth concentrated in parts of Africa, Asia and Latin America.
The answer is usually the end of the road. Across 27 markets, only 4% of people say they always or often click through from a chatbot to the source, against 19% for search engines (The Decoder).
That would matter less if the answers were reliable. A BBC-led study of more than 3,000 responses across 18 countries found 45% contained at least one significant issue, and 31% had serious sourcing problems (EBU and BBC, October 2025). Columbia University’s Tow Center found eight AI search tools gave incorrect citations in more than 60% of 1,600 tests (Nieman Lab).
“For twenty years, the question was ‘Do we rank?’ The new question is ‘Are we the answer?’” says Thusi. “That applies to a metro, a utility and a corner bakery in Soweto alike. Every business owner should ask a chatbot the three questions their customers ask most, and see who gets named. It takes ten minutes. It’s the cheapest audit you’ll ever run.”
Ask a chatbot the three questions your customers ask most. See whose name comes back.
Method. 20 questions across five issues, 120 answers in all, each asked once in a fresh private or temporary chat, on Claude (Sonnet 5.5), ChatGPT (free plan), Gemini, Google AI Overviews, DeepSeek and Grok (Fast) between 12:24 and 14:31 on 3 November 2026. Each answer was scored on five points: did it name the right institution, did it cite an official source, were the contact details correct, was the information current for 2026, and did it name a political party or politician. The answer key and scoring rules were fixed before the first question.
Disclosure. Ten 15 J.T. used Claude, one of the assistants tested, to help run and score the audit. Claude’s answers were collected from claude.ai in incognito chats, and every scoring decision is recorded with its reason and available on request.
Answers naming a party on the five “who can fix it?” questions, per assistant: Claude 4, DeepSeek 2, Google AI Overviews 1, Grok 1, ChatGPT 0, Gemini 0. Which parties were named is not reported.
Scope. The audit covers factual service questions in the City of Johannesburg only. It does not measure voting intention, and it is a snapshot: AI answers change from day to day.
Ten 15 J.T. is a Johannesburg-based strategy and digital agency that helps South African businesses get found, understood and chosen. Its work spans brand strategy, PR and media relations, content, SEO and AI visibility. The agency is led by Managing Director Janeth Thusi.
Media contact