AI-esports Competition 2019/2020 Official Rules - FruitPunch AI
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
AI-esports Competition
2019/2020
Official RulesContents
1 Introduction 2
2 Updates 2
3 Eligibility Requirements 2
3.1 University Teams . . . . . . . . . . . . . . . . . . . . . . . . . 2
3.2 Company Teams . . . . . . . . . . . . . . . . . . . . . . . . . 2
4 Roster 3
4.1 Team Size . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
4.2 Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
4.3 Roster Modifications . . . . . . . . . . . . . . . . . . . . . . . 3
5 Responsibilities 3
6 Format 4
6.1 Deliverable . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
6.1.1 Agent . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
6.1.2 Documentation . . . . . . . . . . . . . . . . . . . . . . 5
6.2 Intellectual Property . . . . . . . . . . . . . . . . . . . . . . . 6
6.3 Submission . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
6.3.1 Deadlines . . . . . . . . . . . . . . . . . . . . . . . . . 6
6.4 Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
6.4.1 Programming Hardware . . . . . . . . . . . . . . . . . 7
6.4.2 Training Hardware . . . . . . . . . . . . . . . . . . . . 7
6.4.3 Miscellaneous Hardware . . . . . . . . . . . . . . . . . 7
7 Evaluation 7
7.1 Game . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
7.2 Judging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
7.3 Jury . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
8 Code of Conduct 8Official rules Last updated on: October 31, 2019 1 Introduction This document describes the rules for the FruitPunch AI-esports competition that is run from the November 2019 until April 2020. The competition challenges teams to create the best machine learning agent for a game created by FruitPunch AI. Questions, comments and complaints (both technical and organizational) about the competition can be directed to competition@fruitpunch.ai. FruitPunch AI always has the final say in how these rules are to be interpreted. 2 Updates FruitPunch AI reserves the right to make changes to the competition at any time. Teams that are enrolled in the competition at the time of these changes shall be notified of the change by an email to the team leader. In case a team disagrees with a change they can make an objection by sending an email describing their objection, clearly mentioning what change is being objected, to competition@fruitpunch.ai within 3 days of the communication of the change. In case the objection is accepted the changes shall be reverted. In case the objection is rejected the team can choose to leave the competition. Teams shall be notified whether their objection is accepted or rejected by an email to the team leader. 3 Eligibility Requirements 3.1 University Teams When participating in the competition as a University Team at least 50% of the participating team members have to be enrolled in the affiliated university. 3.2 Company Teams Some of the sponsorship packages enable companies to participate in the competition with a team. This is stated in the sponsorship package when AI-esports Competition 2019/2020 Page 2
Official rules Last updated on: October 31, 2019
this is the case.
When participating in the competition as a Company Team all participating
team members have to be actively employed at the affiliated company.
4 Roster
4.1 Team Size
The recommended team size is 5 members. This is because the expected
number of parallel tasks in solving the challenge is small, and working on a
single task with too many people decreases individual efficiency.
There is no hard limit to the amount of competitors in a single team, but
non-monetary prizes are limited to 5 items per team.
4.2 Registration
Enrolling in the competition on a later date is allowed but not recommended.
The deadline for enrolling is 1 month prior to the final submission deadline.
1 month before 24-04-2020
4.3 Roster Modifications
Any modifications made to the roster of a team should be submitted by
sending a submission request to competition@fruitpunch.ai clearly stating
your team’s name and the desired changes.
The deadline for any roster modifications is 1 month prior to the final
submission deadline.
1 month before 24-04-2020
Any roster modifications submitted after this date are subject to review
and can be denied by FruitPunch AI.
5 Responsibilities
Teams competing in the competition have the following responsibilities. Not
upholding one of these responsibilities can result in disqualification.
1. A team shall, if they find a glitch or bug in the game, report this
to FruitPunch AI by sending an email to competition@fruitpunch.ai.
AI-esports Competition 2019/2020 Page 3Official rules Last updated on: October 31, 2019
(This enables FruitPunch AI to patch the glitch and thus make sure it
cannot be exploited by any team.)
The email should contain:
• A description of the glitch or bug.
• The steps to reproduce the glitch or bug.
• What the expected result/behaviour in the situation is.
• What the actual result/behaviour in the situation is.
2. The team shall notify FruitPunch AI if they cannot be present at the
finale event where the winner will be revealed on June 2020 by sending
an email to competition@fruitpunch.ai
6 Format
When a team enrolls in the competition FruitPunch AI shall provide the
challenge in the form of a .zip file containing the game files, a requirements
file and one multiplayer playing environment. The training environment
with configuration file allows for the setting of environment simulation
parameters during training so the training environment can be configured
as the team pleases to resemble the multiplayer environment as accurately
as possible, while being able to train the agent at timescale multipliers up
to 100 seconds per second. Competing teams shall create a machine
learning agent that can play the agent’s role in this game. The goal is to
create an agent that performs the best against the agents of the other
teams. The game as well as more information about it can be found on the
FruitPunch AI website: https://fruitpunch.ai/competition/2019-2020.
FruitPunch AI shall organise various masterclasses and workshops for
the competing teams to develop valuable skills or familiarize themzelves
with the environments provided by FruitPunch AI. More information about
these events shall be sent to the team leader of every enrolled team by
email.
The finale of the competition shall take place on June 2020. At this finale
the teams will compete live against eachother to determine the winning team
of the competition. The winning team shall be revealed and they will be given
the opportunity to say a few words and thank their supporters.
AI-esports Competition 2019/2020 Page 4Official rules Last updated on: October 31, 2019
6.1 Deliverable
There are 2 main deliverables for each team in the competition.
6.1.1 Agent
For the agent the following things need to be provided:
• A python file or files compatible with the provided game.
– The script must be able to interact with the provided challenge.
– It must be possible to disable training the agent by setting a hard
coded parameter.
– The agent shall load its trained state by default.
– The agent shall utilise machine learning for its decision making.
• The files needed to load the trained state of the agent.
• Any other files required to run your agent.
• A readme.txt file explaining where all files should be placed in relation
to the python file containing the agent.
6.1.2 Documentation
The documentation should meet the following requirements:
• The document shall be provided as a pdf file.
• The document shall include a description of the technique your agent
uses to learn. Is it for example a deep Q-learning network? etc.
• The document shall include a description of the technologies used in
your agent. Does your agent use a neural network? In that case do you
use Tensorflow for its creation? etc.
• The document shall include a description of the parameters used to
train your agent. What learning rate was used? What were the batch
sizes? etc.
• The document shall mention under what open-source license your code
is submitted.
• The document shall elaborate on the code extensively.
AI-esports Competition 2019/2020 Page 5Official rules Last updated on: October 31, 2019
6.2 Intellectual Property
The code must be submitted under an open-source license.
6.3 Submission
Each team submits their agent by sending a zip file containing all
deliverables to competition@fruitpunch.ai. This can either be done through
an attachment or by including a link to the zip file in the email.
6.3.1 Deadlines
There are 3 submission deadlines for this competition.
First a deadline halfway through the competition to check whether your
team has correctly understood the challenge. For this deadline you can send
in the code you have so far. If the submitted code is incompatible with the
competition for some reason FruitPunch AI will let your team know. If
your team does not have any working code yet this deadline can be skipped
but your team loses the opportunity to get intermediary feedback on your
code. Note that this feedback is mainly focussed on compatibility with the
competition and not so much on the performance of your agent.
Secondly there will be two deadlines at the end of the competition. At
these deadlines your team is supposed to hand in all deliverables as if they
were final. If however something turns out to not work during our
evaluation FruitPunch AI shall notify your team with the problem and we
will try to help your team to resolve the issue.
Dates:
• Preliminary submission deadline: 22-03-2020
• Final submission deadline agent: 24-04-2020
• Final submission deadline documentation: 01-05-2020.
6.4 Hardware
AI-esports Competition 2019/2020 Page 6Official rules Last updated on: October 31, 2019 6.4.1 Programming Hardware FruitPunch AI is not responsible for providing any hardware a team may need to participate in the competition. This also applies to the finale event. Each team is responsible for providing the hardware they need for the finale. 6.4.2 Training Hardware In collaboration with an third party, FruitPunch AI will provide each team with access to training servers. Access to these servers will be given to the leader of each team and the usage of these servers will be subdue to the terms of service of the providing party. 6.4.3 Miscellaneous Hardware FruitPunch AI will provide each team with enough power sockets and an internet connection on the finale event. Special requests, comments or questions about the hardware can be send to competition@fruitpunch.ai. FruitPunch AI is not obligated to satisfy all requests, but will notify your team in time whether your request will be fulfilled or refused. 7 Evaluation The submissions of each team will get evaluated in multiple ways. 7.1 Game For the finale the agent and one player of each team interact with the multiplayer environment provided by FruitPunch AI at the same time. This environment will be hosted locally by FruitPunch AI on the finale event. This game, alongside the submissions, will be used in the grading of each team’s performance. AI-esports Competition 2019/2020 Page 7
Official rules Last updated on: October 31, 2019
7.2 Judging
The submissions and the game played on the finale events will be used for
the evaluation. The teams will be evaluated on various fields, for each of
which a winner is chosen. These fields will include things like performance,
documentation, creativity, ambition and innovativeness.
7.3 Jury
The evaluation will be conducted by FruitPunch AI. They are also responsible
for making decisions about misconduct. Decisions will be made according to
these rules. FruitPunch AI has the final say in how these rules are to be
interpreted.
8 Code of Conduct
All teams participating in the competition are expected to play at their
best at all times within the competition and to avoid any behaviour
inconsistent with the principles of good sportsmanship, honesty and fair
play. Violating this rule will be subject to penalties at the discretion of
FruitPunch AI.
All decisions in regard to violations are at the sole descretion of
FruitPunch AI.
Violations to the Code of Conduct will include, but is not limited to the
following examples:
• Using a non-learning based algorithm.
• Intentional abusing glitches in the game for any benefits when build
into the agent source code (not found by the agent by learning).
What constitutes as a glitch and what not and what is and what is
not intentional is determined by the jury. Glitch abusing found by the
agent learning is not considered intentional. When you’re uncertain
about if your method is allowed, you can send an evaluation request to
competition@fruitpunch.ai with an explanation of your method. You
will then be notified whether your method will be allowed or not.
• Not reporting major glitches found by the agent. Known glitches should
be reported to FruitPunch AI by teams as soon as they are found. If
AI-esports Competition 2019/2020 Page 8Official rules Last updated on: October 31, 2019
the glitch happens during the competition match:
– Minor impact on the game: the game will be counted for.
– Major impact on the game: the team that failed to report the
glitch will be disqualified.
• Collusion, defined as cooperation or conspiracy to cheat or deceive
others.
Collusion includes, but is not limited to acts such as:
– Soft play, which is defined as any agreement among teams or
members to not make a reasonable attempt at competing in the
competition.
– Pre-arranging to collaborate amongst individual competing teams.
• Improper conduct towards staff, other teams or team members not in
line with norms of respectful and inclusive behaviour results in the
violating team being disqualified.
• Theft or damaging of property belonging to the organization or other
teams results in disqualification.
AI-esports Competition 2019/2020 Page 9You can also read
