Methodology

imgsys.org is an open source replication attempt for the project Chatbot Arena by lmsys.org. It is a platform for evaluating open source text-guided image generation while also collecting (and open sourcing) extremely valuable preference data. Please contact us through batuhan [at] fal.ai e-mail address for any inquires.

This is a sister project to both Chatbot Arena as well as the Image Arena by artificialanalysis.ai (check it out for voting on a broad range of base models including the closed source ones).

All the collected preference data (including the prompts and anonymized user IDs) will be released under CC BY-SA 4.0 DEED license.

For the specifics on how we calculate the ELO score, please visit our GitHub repo.