Before the crawl
Paste or upload your list of candidate sites in the app. Gate reads each site for AI training under your profile and shows the answer for each one.
A model team is asked about its data by several people over the life of a model. An enterprise customer asks in a procurement form. An investor asks during diligence. A rightsholder asks in a letter. If you serve the EU, the public summary of training content asks you to describe how you respected reservations of rights. Each of them wants the same thing, which is a record of what each source said and what you did about it.
Paste or upload your list of candidate sites in the app. Gate reads each site for AI training under your profile and shows the answer for each one.
Remove the sites that return Do not collect. Send the holds to a reviewer with the lines Gate quoted. Keep the sites that return Collect or Collect on conditions, and note the conditions.
Your crawler asks the Gate API for each site's current answer and stores the receipt number beside every item it collects.
Your dataset has a receipt for every source. You can count sources by outcome, list the conditions you accepted and show the evidence for any single site.
Decisions expire, so your crawler asks again and collects only from sites whose answer still stands.
Click the scene for the next step
Expect many stops. Many sites have already said no, in robots.txt, in their terms or with a barrier, and a team that has not looked does not know which ones.
Use the India profile if you train and deploy in India only. Use the EU profile if you place a model on the EU market. Use the India and EU Bridge if you are in India now and plan to serve Europe, so that you collect once under the stricter reading of both.