Microsoft built responsible AI measures and guardrails into Copilot from the very beginning.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judged as of 2023-11-15. True: documentation from Microsoft or third parties shows that Copilot products had responsible-AI measures and guardrails at their initial launch, such as content filtering, safety systems, or responsible-AI reviews applied before or at launch (e.g. Bing Chat/Copilot in Feb 2023, Microsoft 365 Copilot). Mostly true: guardrails were present at launch but significant ones were added or strengthened soon after in response to problems. Mixed: some Copilot products had launch guardrails and others clearly did not. Mostly false: dated reports show major guardrails were added mainly after launch in response to incidents (e.g. the Bing chat behaviour incidents of Feb 2023), so 'from the very beginning' overstates what happened. False: evidence shows Copilot launched without meaningful responsible-AI measures or guardrails.
Set before the research began.
Evidence (3)
-
E1 Our approach to Responsible AI - The new Bing Microsoft · April 2023 Own record
“As described above, we have implemented safeguards that mitigate potentially harmful content and we provide parental controls to enable appropriate use by younger users of the new Bing.”
-
E2 Microsoft AI Red Team building future of safer AI | Microsoft Security Blog Microsoft Security Blog · 7 August 2023 Own record
“For instance, before the new Bing chat experience was released, a team of dozens of security and responsible AI experts across the company spent hundreds of hours probing for novel security and responsible AI risks.”
-
E3 OpenAI reportedly warned Microsoft about Bing's bizarre AI responses The Verge · 13 June 2023
“Microsoft was quick to limit Bing Chat responses to stop the AI from getting real weird, and it has taken months of work to get the Bing chatbot back to a point where you can have a long back-and-forth conversation without an unexpected outburst.”
Reasoning
Microsoft's own security blog [E2] says dozens of security and responsible-AI experts red-teamed the new Bing chat for responsible-AI risks before it was released. Microsoft's April 2023 Responsible AI document [E1] describes safeguards against harmful content. The Verge [E3], an independent source, reports that Microsoft was quick to limit Bing Chat responses to stop unusual behaviour, and that it took months of further work before long conversations were possible without unexpected outbursts. Together this fits the criteria's "mostly true": there were responsible-AI measures at launch, but significant guardrails were added soon after in response to problems.
Cite this claim
Satya Nadella, “Microsoft built responsible AI measures and guardrails into Copilot from the very beginning.” (said 15 November 2023). Verdict: mostly true. Reliability API, claim c_786e794df0fa, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_786e794df0fa
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Satya Nadella
-
Resolved true
“MXC is a new policy layer that lets Windows apply isolation and containment using AInative or other OS-native primitives.”
-
Mixed
“I was able to use a model that is using 500B, I was able to use a 5B, and have it really deliver the same outcome, why would I not use that?”
-
Mostly false
“it turned out we sold a lot more subscriptions because people who never bought servers from us were buying subscriptions.”
-
Mostly true
“I always go back to the story of having built SQL Server with SAP.”
-
Mostly true
“we didn’t raise prices for a decade plus. That’s all thanks to the software efficiencies on top of hardware.”
Verdicts are made automatically; how verdicts are made.