Rules
The rules of this competition aim to ensure fair evaluation and reproducible results. To this end, we require the following:
-
Each team is limited to a maximum of five members. Teams must self-certify that no team member is participating in multiple teams for this competition.
-
All teams are encouraged to submit their models for a preliminary review. After the review deadline, only three submissions are allowed for each team and the best-performing model will be used to rank the team.
-
The use of exclusively C4 and Alpaca datasets is permitted for participation in this competition. The utilization of data or content that violates service agreements or proprietary information of any entity is strictly prohibited. Submissions must refrain from employing any copyrighted or proprietary data, code, or closed-source content.
-
All submissions must ensure full reproducibility. The top three teams in each track category, with the highest scoring models, are mandated to provide all essential code and data required for replicating their model. Their submissions must be open-sourced and made publicly accessible after the competition.
-
It is not allowed to mix submissions across tracks. Models compressed from pre-trained LLMs cannot be submitted to the training-from-the-scratch track, and vice versa.
-
This competition will be run under the honour system. Teams that submit very similar results or copy another team’s solution will be disqualified. Violating the spirit of the honour system or taking unfair advantage of the community, even when not against an explicit rule, may result in disqualification and ineligibility for prizes.
-
Competition participants can communicate with the organizers to ask questions via various ways such as emails, GitHub issues, and Discord channels. Any updates to rules or deadlines will be timely demonstrated on our website and communicated through our Discord channels.
-
Organizers, volunteers and advisors associated with the competition are not allowed to participate.