Anubis (software)

Anubis
	Mascot of Anubis
Original author(s)	Xe Iaso
Initial release	January 19, 2025; 3 months ago
Repository	github.com/TecharoHQ/anubis
Written in	Go
License	MIT License
Website	anubis.techaro.lol

Anubis is a software program that makes web scraping harder by using a proof of work mechanism.^[2]^[3]

It was created by Xe Iaso in response to Amazon's web crawler overloading their Git server, as it did not respect the robots.txt exclusion protocol and would work around restrictions.^[2] It is used by the GNOME Project's GitLab instance.^[2]

References

^ Iaso, Xe (19 January 2025). "Block AI scrapers with Anubis". xeiaso.net. Retrieved 2 May 2025.
^ ^a ^b ^c Edwards, Benj (2025-03-25). "Open source devs say AI crawlers dominate traffic, forcing blocks on entire countries". Ars Technica. Retrieved 2025-05-02.
^ Bort, Julie (2025-03-27). "Open source devs are fighting AI crawlers with cleverness and vengeance". TechCrunch. Retrieved 2025-05-02.

External links

Official website
anubis on GitHub

[1] Iaso, Xe (19 January 2025). "Block AI scrapers with Anubis". xeiaso.net. Retrieved 2 May 2025.

[Edwards02-2] Edwards, Benj (2025-03-25). "Open source devs say AI crawlers dominate traffic, forcing blocks on entire countries". Ars Technica. Retrieved 2025-05-02.

[3] Bort, Julie (2025-03-27). "Open source devs are fighting AI crawlers with cleverness and vengeance". TechCrunch. Retrieved 2025-05-02.

[1]

[2]

[3]