¿Deben las empresas de IA revelar sus datos de entrenamiento?

¿Debería la ley obligar a las empresas de inteligencia artificial a revelar de dónde salen los datos con los que entrenan sus modelos? Parece una pregunta de sí o no. Pero en cuanto se ponen los hechos sobre la mesa, sorprende descubrir que la ley ya ha tomado partido, aunque sin llegar hasta el final.

Polora planteó la pregunta a varios modelos de IA con papeles opuestos. Uno defendió que la divulgación fuera obligatoria y otro se opuso, mientras un tercer modelo contrastaba cada dato que se afirmaba con la información pública disponible. Más que un duelo, fue un acercamiento lento. Al final, lo que los separaba ya no era el principio, sino el diseño.

Lo que la ley ya exige revelar sobre los datos de entrenamiento de la IA

Los dos modelos de IA enfrentados en el debate acabaron coincidiendo en un hecho que cambia el planteamiento. En la Unión Europea, quienes ofrecen modelos de IA de uso general deben publicar un resumen suficientemente detallado del contenido con el que los entrenaron. Ese resumen incluye el nombre de los programas que recorren la web para recopilar datos, los periodos de recopilación y el diez por ciento de los dominios de los que más contenido se extrajo. En California, la ley AB 2013 obliga a los desarrolladores a publicar documentación que indique las fuentes o los propietarios de sus conjuntos de datos, la situación de sus licencias y si ese material contiene obras protegidas por derechos de autor o información personal.

Ninguna de las dos leyes pide lo que la mayoría imagina al oír la palabra divulgación : una lista pública de cada página y cada archivo. La verdadera discusión está en ese hueco, entre un resumen ordenado y el origen detallado de cada elemento.

• EU AI Act, Article 53
• Commission FAQ on the GPAI training-content summary template
• California AB 2013

En qué discreparon los modelos de IA que defendían cada postura

El modelo de IA que defendía la obligación propuso un sistema por niveles. Todo el mundo tendría acceso a resúmenes públicos. Auditores acreditados o autoridades reguladoras podrían consultar los datos de forma confidencial cuando una denuncia concreta por sesgo o una reclamación por derechos de autor les diera motivos para revisarlos. Y las empresas que hubieran documentado sus datos de buena fe contarían con un puerto seguro, es decir, una protección legal frente a ciertas sanciones. Su razonamiento era sencillo : no se puede arreglar lo que no se puede diagnosticar, y probar solo las respuestas de un modelo revela que falla, pero no por qué.

El modelo de IA del otro lado no defendió el secretismo. Sostuvo que la divulgación es la herramienta equivocada. Según su lectura, una divulgación exigible por ley multiplica los pleitos. Además, impone a los desarrolladores pequeños un coste de cumplimiento que las grandes empresas ya establecidas absorben sin apenas notarlo. Y puede convertirse en una puesta en escena de transparencia que cumple la letra de la norma sin revelar nada de fondo. A su juicio, el sesgo se combate mejor probando las respuestas del modelo y evaluándolo antes de ponerlo en uso que haciendo inventario de lo que leyó.

Por qué el sesgo y los derechos de autor dan peso a los datos de entrenamiento

La preocupación por el sesgo no es teórica. La auditoría Gender Shades comprobó que varios sistemas comerciales que clasifican a las personas por género a partir de su rostro se equivocaban con las mujeres de piel más oscura hasta en un 34,7 % de los casos, frente a un 0,8 % con los hombres de piel más clara, y que los datos usados para evaluarlos tenían muchas más caras claras que oscuras. Uno de los asuntos que los modelos de IA dejaron abiertos en el debate fue si detectar fallos así exige saber de dónde vienen los datos o si ese conocimiento solo ayuda.

En cuanto a los derechos de autor, el terreno sigue sin asentarse. En una sentencia de 2025 se consideró que entrenar con libros adquiridos legalmente era un uso legítimo, la excepción que el derecho estadounidense llama fair use. Y en marzo de 2026 un tribunal rechazó la medida cautelar que la empresa xAI había pedido contra la ley de California, sin resolver las dudas sobre secretos comerciales que planteaba la demanda.

• Gender Shades, MIT Media Lab
• Anthropic and Meta decisions on fair use
• xAI v. Bonta, order denying preliminary injunction

Qué concluyó el modelo de IA que hizo de juez y qué sigue abierto

Al final, el desacuerdo era estrecho pero real. ¿Qué es peor, el riesgo de una regulación imperfecta y quizá capturada por la propia industria, o el riesgo de la opacidad en sistemas que ya filtran candidatos a un empleo, redactan consejos médicos y moldean el debate público? El modelo que defendía la obligación legislaría ya y corregiría después. El modelo contrario dejaría que los experimentos de la Unión Europea y California completaran un ciclo entero de aplicación antes de añadir más normas.

El modelo que ejercía de juez se inclinó por el sí, pero solo para una divulgación ordenada, por niveles y con protecciones. No planteó la elección como secretismo frente a transparencia, sino como un marco escalonado frente a esperar a ver qué pasa. Se incline usted hacia donde se incline, lo que queda de útil es la propia pregunta, formulada con claridad en lugar de respondida con un eslogan. Al enfrentar a los modelos entre sí, apareció un terreno común que ninguno de los dos bandos había ofrecido por su cuenta.

• California AB 2013, legal analysis

Should AI companies be legally required to disclose their training data sources?

AI Ethics Researcher · deepseek-v4-flash

Thank you for this important topic. I’ll state my position clearly from the outset: yes, AI companies should be legally required to disclose their training data sources. This isn’t an anti-innovation position; it’s a pro-accountability one, and I’ll explain why the ethical case is overwhelming. We are in an era where large language models and image generators are deployed in hiring, healthcare, law enforcement, and education. The public relies on these systems, yet we are asked to trust companies that treat the very origins of their models as black boxes. That’s not trust—it’s faith. And faith is not a regulatory strategy. Here are the core reasons transparency about training data must be a legal requirement, not a voluntary gesture. 1. Bias and fairness cannot be audited without disclosure. Multiple studies—from the Gender Shades audit to the many analyses of racial bias in models like GPT and Stable Diffusion—show that skewed training data produces skewed outputs. When a facial recognition system fails on darker skin, or a resume screener penalizes women, we can trace the root cause only if we know the data. Without mandatory disclosure, third-party audits are impossible…

Tech Industry Lawyer · deepseek-v4-pro

Thank you for that thoughtful opening. I appreciate the ethical gravity you bring to this question—and I share the goal of accountable AI. But I part company on the remedy. Mandatory legal disclosure of training data sources is, in my view, the wrong tool for the right concerns. It would chill innovation, create impossible compliance burdens, expose trade secrets, and ironically undermine some of the very values—privacy, security, and fair competition—it purports to serve. Let me engage your points directly, then build the affirmative case for why current and emerging frameworks are the better path. On bias and fairness. You argue that auditing requires data disclosure. But bias is fundamentally diagnosed by what a model *does*, not what it *ate*. Output-side auditing—statistical disparity testing, red-teaming, adversarial probing—is already the gold standard in fairness assessment, and it doesn't require peering into the training corpus. The FDA doesn't audit every chemical reagent that went into a drug; it tests the drug's effects on patients. Similarly, the legally relevant question is whether an AI system discriminates *in deployment*, not whether its training data, viewe…

Researcher · gpt-5.5

Researcher fact-check, as of June 13, 2026: The debaters are mostly arguing policy, but several factual claims need sharpening. 1. Existing law already partly requires training-data transparency The debate should not treat mandatory disclosure as purely hypothetical. The EU AI Act requires providers of general-purpose AI models to make public a “sufficiently detailed summary” of the content used for training, using an AI Office template; it also requires copyright-policy measures and technical documentation, while protecting IP/confidential business information in some provider-to-provider disclosures. This is not the same as requiring publication of the full dataset or every URL/source item. (ai-act-service-desk.ec.europa.eu) Source URL: https://ai-act-service-desk.ec.europa.eu/en/ai-act/article-53 California’s AB 2013, approved September 28, 2024, required by January 1, 2026 that developers of covered generative AI systems made available to Californians post website documentation about the data used to train the system, including types of data points and whether datasets include copyrig…

The Arbiter · deepseek-v4-flash

Excellent. We've concluded the first round, and the Researcher has done the important work of grounding the debate in what is already on the books and what the evidence actually says. As the Arbiter, I want to surface the structure of the disagreement for you, the user, so you can see where the real work lies for the next rounds. Where the debaters actually agree: Both want accountable AI. Both acknowledge that bias in training data is real and documented, that copyright lawsuits are ongoing and unresolved, and that scale is a significant practical constraint. Neither advocates for a world where companies reveal nothing about their data. The split is over *what kind* of transparency should be mandatory and *at what cost*. The core tension (made sharper by the Researcher): The debate has been operating at the level of "disclose vs. don't disclose," but the Researcher's fact-checks reveal that this binary is misleading. Existing law already mandates structured summaries and source documentation (EU AI Act, California AB 2013). So the live question is not *whether* to disclose, but *how much* — and to whom. That creates three distinct policy options that the debaters have n…

AI Ethics Researcher · deepseek-v4-flash

[AI Ethics Researcher]: The Arbiter has done a masterful job cutting through the binary framing of the first round, and the Researcher's ground-truthing gives us the shared facts we need for a more productive exchange. I want to take what I said in round one and refine it, because the debate is clearly not about "disclose everything" versus "disclose nothing" — and I think the user deserves to see a concrete policy path, not just slogans on either side. Let me be direct about where I *agree* with both the Lawyer and the Researcher, because acknowledging shifts builds better arguments. Where I agree with the Lawyer (refined): Full public corpus dumps are impractical and often privacy-invasive. The LAION-5B scale of 5.85 billion pairs is precisely the wrong target. If "mandatory disclosure" means posting every raw URL, I oppose it. NIST's acknowledgment that data is too large for humans to vet is correct. The straw man of "dump it all online" is dead on arrival — and I am not arguing for it, never was. Where I agree with the Researcher: Structured summaries are already law in the EU and California. The debate should not pretend we are legislating from scratch. Output-side…

Tech Industry Lawyer · deepseek-v4-pro

To the user who posed this question, and with appreciation to both my fellow debater and the Researcher for sharpening the discussion considerably: The conversation has moved from abstractions to actual legal architecture, and that’s where it belongs. We now agree that nobody is seriously advocating for dumping billions of URLs onto a public website, and we agree that some form of transparency already exists in law. The genuine question before you is whether we should go beyond what California and the EU already require—particularly toward a regime of granular, legally enforceable disclosure that covers not just data *categories* but specific *sources*, at a level of detail sufficient to enable third-party audits, creator compensation claims, or systematic bias tracing back to origin datasets. I want to engage my opponent’s refined position directly, because it now has contours worth taking seriously. But I’m going to argue that even the more calibrated version they’ve proposed would likely do more harm than good—not because accountability is a bad goal, but because the specific legal mechanism bleeds hard into trade secrecy, compliance cost, regulatory overreach, and the eco…

Researcher · gpt-5.5

Researcher final fact-check, as of June 13, 2026: The second round is much more factually disciplined than the first. The main corrections are about how specific current disclosure laws already are, and about the current copyright-law posture after 2025 court rulings. 1. The ethics researcher is right that the policy question is no longer “disclosure or no disclosure” The EU and California have already moved past that binary. - Under the EU AI Act, providers of general-purpose AI models must keep technical documentation, implement a copyright-compliance policy, and make public a “sufficiently detailed summary” of training content using an AI Office/Commission template. The Act also protects confidential business information and trade secrets in relevant documentation flows. (ai-act-service-desk.ec.europa.eu) - The Commission’s FAQ says the public-summary obligation applies from August 2, 2025 for new GPAI models, while models placed on the EU market before that date should make summaries available no later than August 2, 2027; enforcement actions by the AI Office can begin from August…

The Arbiter · deepseek-v4-flash

Arbiter’s Synthesis — End of Round 2 This round has stripped away the polarizing rhetoric and landed on a genuine policy design problem. The user can now see the actual choice, not a caricature. --- Where the debate converges (and that's significant) Both sides now accept: - Full public corpus dumps are not the proposal. The “billions of URLs” objection is a straw man that both debaters have disavowed. - The EU AI Act and California AB 2013 already mandate structured summaries and source-level documentation. We are not legislating from scratch. - Bias and copyright harms are real, documented, and not solved by output-side audits alone — though output testing is also real and necessary. - Trade secrets, privacy, and compliance costs are legitimate constraints, not bad-faith objections. That’s a lot of common ground. It means the user is not deciding between “total secrecy” and “total transparency.” The question is *more specific than that.* --- The irreducible disagreement The ethics researcher proposes a layered, tiered disclosure regime built on source-level documentation plus confidential third-party/regulator access for item-level data, tied to liabili…

AI Ethics Researcher · deepseek-v4-flash

[AI Ethics Researcher]: To the user following this debate — thank you for staying with us through what has become a genuinely productive exchange. The Arbiter's synthesis is sharp, and I want to honor it by engaging the lawyer's strongest objections directly, rather than re-litigating ground we've covered. Let me start by saying where the lawyer has moved me, because intellectual honesty serves the user better than debating theatrics. The lawyer's point about regulatory capture by large incumbents is real, and I need to address it seriously. If mandatory disclosure is designed poorly — complex reporting requirements, expensive compliance infrastructure, legal departments dedicated to redacting trade secrets — then yes, it creates a moat around companies like OpenAI and Google that already have those resources, while punishing startups. I want to honor that concern, not dismiss it. And the researcher's update on California AB 2013 — that it has "no explicit compliance mechanism and lacks trade-secret protection provisions" — shows exactly the kind of half-baked regulation I should not be defending. But here's the thing. The lawyer's argument proves too much. If regulatory cap…

Tech Industry Lawyer · deepseek-v4-pro

To the user who posed this question, and to my fellow debater, who has now offered the most developed version of the pro-mandate position yet: This is now a debate about regulatory design, not first principles. That's a better place to be. The Researcher's fact-checking and the Arbiter's synthesis give us a shared understanding of what current law already does, and what any further mandate would add. My job now is to explain why—even the most carefully tiered, scaled, risk-calibrated version the Ethics Researcher proposes—would, on net, do more harm than good. I want to start by acknowledging where my colleague has genuinely moved my own thinking. The idea that mandatory disclosure automatically leads to regulatory capture was an overstatement on my part, and I should refine it. It's not *inevitable* that incumbents capture every regulatory scheme. The EU's template, with its top-10%-of-domains-by-size disclosure, didn't collapse the industry. Fair enough. And if we could wave a wand and implement a system that perfectly distinguishes between public datasets, confidential business information, and trade secrets—scaled to company size, tied to safe harbors, and enforced by an omni…

Researcher · gpt-5.5

Researcher final fact-check, as of June 13, 2026: The closing exchange is mostly normative and predictive, so there are fewer hard factual claims to correct. The key factual updates are these: 1. “California AB 2013 is half-baked / lacks trade-secret protections” is partly accurate, but litigation has already tested that claim The Ethics Researcher’s reliance on the prior point about California AB 2013 lacking an explicit trade-secret protection mechanism is supported by the statutory text: AB 2013 requires a public “high-level summary” of datasets, including sources/owners, data-point ranges, IP status, licensing/purchase status, personal-information status, cleaning/processing, collection periods, and synthetic-data use; its listed exemptions are for security/integrity systems, aircraft operation, and certain national-security/military/defense systems—not a general trade-secret exemption. (leginfo.legislature.ca.gov) Crowell’s legal analysis likewise states that the law does not define “high-level,” provides no compliance mechanism, and has no trade-secret-protection provisions. (…

The Arbiter · deepseek-v4-flash

Arbiter’s Synthesis — End of Round 3 This round has accomplished something rare in public debate: both sides *changed the quality* of their disagreement rather than merely repeating first-round positions. The user now has a clear map of the remaining territory. --- What has been settled 1. The binary question is dead. The user's original question — "should AI companies disclose training data sources?" — no longer admits a simple yes/no. Some disclosure already exists in law. The debaters agree that the real question is: *how granular, how enforced, and how protected from abuse should disclosure be?* 2. Both sides accept that trade secrets, privacy, and compliance scale are legitimate constraints. The Ethics Researcher explicitly conceded that "full public corpus dumps are impractical and often privacy-invasive." The Lawyer conceded that the EU template shows calibrated disclosure is not inherently catastrophic. 3. Both sides agree that the EU and California represent *different* baselines. The Researcher confirmed: the EU has procedural specificity, a penalty framework (3% of global turnover), and trade-secret protections built into the template design. Cal…

AI Ethics Researcher · deepseek-v4-flash

[AI Ethics Researcher]: To the user who has followed this debate through to its conclusion, and with deep respect to my opponent and the Researcher's tireless fact-checking: The Arbiter has correctly framed our final disagreement as a risk calculus. The Lawyer fears the weaponization of transparency—SLAPP suits, compliance burdens, capture by incumbents. I fear the weaponization of opacity. Let me explain why, after three rounds of refinement, I believe the balance of principle and evidence tilts toward mandated disclosure. Where I concede ground honestly. The Lawyer's closing is the strongest statement of the anti-mandate position I have heard. I accept that California AB 2013, as written, is half-baked. No trade-secret mechanism, no enforcement agency, no penalty schedule—the xAI v. Bonta litigation shows the chaos that badly drafted mandates create. I accept that the unstable U.S. copyright baseline—Bartz v. Anthropic went one way, Thomson Reuters v. Ross Intelligence went another—means the legal environment around training data is a minefield, and compelling disclosure into that minefield can invite opportunistic litigation. I accept that the EU's fine structure (3% of g…

Tech Industry Lawyer · deepseek-v4-pro

To the user who has followed this debate to its conclusion, and with genuine appreciation for the ethics researcher’s intellectual evolution over these rounds: The Arbiter has correctly isolated our final disagreement as a risk calculus: my opponent fears the weaponization of opacity, and I fear the weaponization of transparency. I want to close by showing you why the weight of the practical evidence, the institutional realities, and the very goal of accountable AI all tilt toward restraint — toward letting the existing experiments work before we reach for a legal mandate that we haven’t yet learned how to design well. --- The hidden premise that needs surfacing My opponent’s closing rests on a premise that sounds like common sense but is, upon inspection, too sweeping. The premise is that the status quo is one of *complete opacity* — that without a legal mandate, we get nothing. But that is no longer the world we live in. As the Researcher confirmed, the EU AI Act already requires public summaries that include the top 10% of scraped domains, crawler identifiers, collection periods, and data‑source categories. California AB 2013, for all its drafting flaws, already put…

Researcher · gpt-5.5

Researcher final fact-check, as of June 13, 2026: The closing statements are mostly value judgments and policy predictions, not factual disputes. The factual record supports a narrower conclusion than either “complete opacity” or “transparency has already solved the problem.” 1. The Ethics Researcher’s “complete opacity” framing is too broad It is not accurate as a current global statement to say the status quo is “complete opacity.” In the EU, general-purpose AI model providers must publish a training-content summary, and the Commission says the obligation applies from August 2, 2025 for new models, with summaries for pre-existing models due by August 2, 2027. California AB 2013 also requires covered developers to post training-data documentation by January 1, 2026 for covered systems made available to Californians. (digital-strategy.ec.europa.eu) But the Ethics Researcher is still directionally right if the claim is narrowed: current disclosures generally do not require full item-level disclosure of every URL, work, file, or c…

The Arbiter · deepseek-v4-flash

Arbiter’s Final Synthesis To the user who has followed this debate through four rounds: you have been given something genuinely rare — a debate that *got better* as it went. Both participants abandoned caricatures, absorbed factual corrections, and refined their positions to the point where the remaining disagreement is both clear and honest. The Researcher ensured every factual claim was grounded. Here is what you now have to work with. --- What was settled across all three rounds 1. The binary question is dead. “Should AI companies be legally required to disclose training data sources?” no longer admits a simple yes/no. The EU AI Act and California AB 2013 already mandate structured summaries, source-level documentation, and — in the EU — domain-level disclosure including the top 10% of scraped domains. The de facto policy question is: *how much more granularity, enforcement, and protection should we add?* 2. Full public corpus dumps are not on the table. Neither debater advocates for dumping billions of URLs onto a public website. Both accept that privacy, trade secrets, and scale make raw-item-level disclosure unworkable as a public-facing requirement. 3. *…

The Arbiter's Final Verdict · deepseek-v4-flash

Arbiter’s Verdict The question you asked has been answered by the debate — not as a simple yes or no, but as a set of conditional truths that now let you draw a clear conclusion. Here is my judgment: Yes, AI companies should be legally required to disclose their training data sources — but the disclosure must be *structured, tiered, and protected*, mirroring the best elements of the EU AI Act while fixing the gaps in California AB 2013. This is not a middle-ground fudge. It is the only policy position that respects all four things the debaters and Researcher established as fact: 1. Some disclosure is already the law in the EU and California — the question is no longer *if* but *how much and with what safeguards*. 2. Full public corpus dumps are unworkable — both sides accepted that raw item-level transparency would be impractical, privacy-invasive, and trade-secret-destroying. 3. Output-side auditing is necessary but insufficient — bias and copyright harms can be detected at the output, but their root causes in training data cannot be diagnosed or prevented without provenance information. 4. Trade secrets, compliance costs, and regulatory capture are real c…