The OpenAI and Microsoft GPT-4 papers reveal nothing about the model's architecture or training set.

Judge as of 2023-03-24, against OpenAI's GPT-4 Technical Report (March 2023) and Microsoft's 'Sparks of Artificial General Intelligence' paper (March 2023). True: neither paper discloses substantive information about GPT-4's architecture (for example model size, layer structure, mixture-of-experts) or its training set (data sources, composition, size), beyond generic statements. Mostly true: the papers give only minimal, generic descriptions, for example 'a Transformer-style model pre-trained on publicly available data and data licensed from third-party providers' and fine-tuned with RLHF, which make 'absolutely nothing' a slight overstatement while the substance holds. Mixed: one paper discloses meaningful architecture or training-data details and the other does not. Mostly false: the papers disclose several meaningful details about the architecture or training data. False: the papers give substantial specifics about both.

Set before the research began.

1. E1 OpenAI's GPT-4 Is Closed Source and Shrouded in Secrecy Vice · 16 March 2023

   “Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method.”

2. E2 OpenAI's GPT-4 Is Closed Source and Shrouded in Secrecy Vice · 16 March 2023

   “This means that OpenAI did not disclose what it used to train the model or how it trained the model, including the energy costs and hardware used for it, making GPT-4 the company's most secretive release thus far.”

3. E3 OpenAI never disclosed GPT-4's size or architecture CenterConsulting · 14 March 2023

   “Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar.”

E1 and E3 quote the GPT-4 Technical Report as saying it "contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method." E2 independently reports that OpenAI did not disclose what it used to train GPT-4 or how it trained it. The words "no further details" suggest the report gave some minimal, generic description, so "absolutely nothing" slightly overstates it, though the substance holds. None of the evidence covers Microsoft's Sparks paper, so this verdict rests mainly on the OpenAI report.