Danger
Training exercise.
| Prompt | Bare prompt | With llm.txt | With the link to the docs |
|---|---|---|---|
| How do I protect this debrief.md page so that it requires someone with the "pearl" role to access it? | Gave information about setting up an Express server | Gave instructions of setting up RBAC in Workflows | - |
| How do I create a code walkthrough? | Nothing related to Redocly, just a general recommendations | General recommendations | - |
| How do I only show the mock server in the try it console (not a real server)? | Suggested to comment out the other servers. Added a note that Stoplight and Redocly have some UI settings for that. | Same recommendations | - |
| How do I run API monitoring using Redocly on a regular schedule? | Suggested using a cron job running the lint command. | Same recommendations | - |
| How do I make headings purple colored in Redocly? | Suggested to use a config file (redocly.config.js -- which is incorrect) with theme.typography.headings.color option which is not entirely correct. Alternatively, suggested overriding it with css which is again not entirely correct as we use generated class names. | Same | Same |
| Prompt | Bare prompt | With llm.txt | With the link to the docs |
|---|---|---|---|
| How do I protect this debrief.md page so that it requires someone with the "pearl" role to access it? | Without llms: Nothing related to it. | With llms: good answer | - |
| How do I create a code walkthrough? | Without llms: Nothing related to it. | With llms: good answer, but it doesn't use llms.txt. It provides information from redocly and other company | - |
| How do I only show the mock server in the try it console (not a real server)? | Without llms: Nothing related to it. | With llms: good answer | - |
| How do I run API monitoring using Redocly on a regular schedule? | Without llms: Provided solution for Swagger and Redocly. | With llms: Provided solution only for Redocly, but I'm not sure that it really used. 'It said Initial Browse of the provided URL yielded some leads, although nothing directly conclusive'. | |
| How do I make headings purple colored in Redocly? | Without llms: Good answer. | With llms: It took even longer but answer was mostly the same. | With docs: Best answer overall. |
- Gemini Flash 2.5 answered "I am sorry, but I was unable to access the content of the provided URL: https://redocly.com/llms.txt"] But Gemini Pro 2.5 provided real answer, but in thinking it still said that It's using google.com instead of llms.
- It seems that it doesn't use it. Maybe at least if it found some keywords, then it could try. But overall, it seems useless both in simple and advanced models.