6G AI Competition - Amazon S3
-
Upload
khangminh22 -
Category
Documents
-
view
2 -
download
0
Transcript of 6G AI Competition - Amazon S3
The organizer - Guangdong OPPO Mobile Communications Corp., Ltd.
◼ Competition Background
The deep integration of wireless communication and artificial intelligence (AI) has become an
important direction for the construction of future wireless communication systems. At present,
many researches with good results on AI solutions for specific modularization problems of 5G
wireless communication systems have been carried out in academia and industry. At the same
time, with the evolution from 5G to 6G, researchers have once again obtained the opportunity
to ponder, define and build a new generation of wireless communication systems. In this
process, many constraints in current system can be relaxed, and the direction and depth of the
integration for 6G and AI can further be expanded.
Based on the above background, we launched the "6G AI Competition", which aims to combine
the strengths of all parties and the promotion of the competition to systematically and
comprehensively study the impact of AI on the future wireless communication system and the
solutions for key issues. In the first stage of the competition design, from the perspective of
methodological innovation, we introduce some common problems that AI-based solutions need
to face, and will comprehensively promote the technological breakthrough and industrial
landing of smart 6G.
◼ Competition Schedule
The competition will be held online, and technology sharing and awarding will be carried out
offline. Contestants should register, team up, and submit the model for evaluation on the
official platform DataFountain. After the online competition, the top ten teams or individuals
whose submitted models have been reviewed need to participate in the seminar and attend the
6G AI Competition
award ceremony.
The schedule is as follows:
- December 24, 2021:The competition tasks are released, contestants can log in to
the official website for registering:
https://www.datafountain.cn/competitions/557?lang=en-US
- January 4, 2022 12:00 (Beijing time):The dataset is released and the registration
on the official website is open. Contestants registered can log in to the official website
to download the dataset. At the same time, the competition officially enters the
evaluation stage. Contestants can submit the required files online to the competition
platform. Each team can submit up to 3 times a day. The evaluation system will
automatically evaluate the score and update it to the leaderboard. The highest scores
of each contestant will be recorded on the leaderboard, and the relevant teams must
save the source code of the highest score for review.
- March 8, 2022 12:00 (Beijing time):Deadline for registration and team formation.
- March 11, 2022 24:00 (Beijing time):The evaluation platform is closed, and the
leaderboard is locked.
- March 11 - 31, 2022:After reviewing the submission of the top ten teams, the teams
will be awarded the Golden, Silver, Bronze and the Winning prize in descending order
of the evaluation results. The winning teams must participate in the seminar and the
award ceremony. Teams that do not participate will abandon the competition by
default. Note: After receiving the notification from the organizing committee, if the
top ten teams fail to submit their materials or abandon the competition, the organizing
committee will notify other teams to submit review materials based on the ranking.
- April 10, 2022:Seminar and award ceremony. Note: if the time is changed due to
force majeure or other factors, the organizing committee will notify the winning
teams as soon as possible. If the winning team is from outside of China, online access
is recommended for participating in the seminar and the award ceremony.
◼ Irregularities
If the participating team has the following or other major irregularities, the qualifications and
results of the competition can be cancelled after the discussion of competition organizing
committee, and the list of winning teams will be postponed sequentially.
a. Serious violation of competition rules,
b. Cheating by using multiple accounts, colluding, plagiarizing others’ codes, etc.,
c. Use of external data without permission, (Including but not limited to using external data
directly or indirectly without permission)
d. Other major violations.
◼ Bonus
Golden Prize: 300,000 RMB for 1 team
Silver Prize: 50,000 RMB (per team) for 2 teams
Bronze Prize: 20,000 RMB (per team) for 3 teams
Winning Prize: 10,000 RMB (per team) for 4 teams
Note 1– the award can be settled in US dollars according to the exchange rate on the settlement
date
Note 2– the individual income tax or other forms of tax on the bonus will be borne by the
winners, and will be withheld and paid by the organizer of the competition. The participating
teams shall be responsible for the distribution and distribution of the bonus among their
members, and the organizer will not be held responsible for this.
◼ Competition Rules
• Participants: The competition is open to all the people around the world, regardless of age
or nationality. All colleges and universities, scientific research institutions, enterprises,
maker teams, individuals, etc. can log on to the official website to register for the
competition. Guangdong OPPO Mobile Telecommunications Corp., Ltd and affiliated units
of which can participate the competition but cannot win prizes, and will not occupy the
prize quota (i.e. if the team is in the top 10 of the rank after the rank is locked, the team will
not be awarded, nor will it occupy the award quota. The team can participate in sharing
activities. The winning team will be ranked in sequence except for this team).
• Registration requirements: Each person can only participate in one team (1-5 team
member per team(s)) for each track. All team members must provide basic personal
information and pass the real-name certification when registering the competition. The
team formation must be completed before the deadline. Once the formation of the team is
completed, team members cannot quit from the team.
• Team up conditions: In order to ensure that each team has a relatively equal opportunity
for submission, the total number of submissions of all members in a team must be no larger
than 3 times of the number of days open for evaluation.
• Submission of works: Contestants can submit up to 3 works per day on the competition
platform, and the evaluation system will automatically evaluate the score. Entries must
guarantee originality, do not violate any relevant laws of the People’s Republic of China,
and do not infringe any third-party intellectual property rights or other rights. Once
discovered or submitted and verified by the right holder (within 1 month after the
publishing of final winner list of the competition), the committee will cancel its competition
results and deal with it seriously.
• Winning conditions: The top 10 teams on the list at the end of the online evaluation will
be the winning teams. If any team quits the competition (the committee failed to contact
any member of the team for three consecutive days according to the contact information
provided by the contestants, or the team took the initiative to quit the competition), the list
of winners will be filled with following teams by sequence. Contestants need to cooperate
with the committee to verify the validity and authenticity of the submitted competition
works, and at the same time check the correctness of the works by themselves, and submit
them after confirming that they are correct. The committee is not responsible for making
changes and adjustments to the submitted competition works.
• Fair competition: Participants are not allowed to use rule loopholes or technical loopholes
to improve their rankings outside the scope of the designated assessment technical ability,
and it is forbidden to copy other people’s works, exchange answers, and use multiple IDs
in the competition. It is forbidden for different contestants to submit similar works
maliciously. The committee will cancel the unfair competition results and deal with it
seriously.
• Organization statement: The committee reserves the right to adjust and modify the rules
of the competition, the right to determine and dispose of cheating in the competition, and
the right to withdraw or refuse the award of the participating team that affects the
organization and fairness.
• Competition data: The committee authorizes participants to use the provided data to
conduct model training for the designated contest. Participants are not allowed to use the
data for any commercial purposes. If it is used for scientific research, please indicate the
relevant data provider.
• Intellectual property rights of works: The intellectual property rights of the works
(including but not limited to algorithms, models, etc.) belong to the contestants. The
committee can use the works, works-related materials, and participating team information
for promotional materials and related publications, e.g. designated and authorized media
releases, official website browsing and downloads, exhibitions (including touring
exhibitions) and other activities, under the consent of the contestants. The organizers of the
competition have the priority of cooperation.
• Special avoidance: Personnel involved in track design and data provision in Guangdong
OPPO Mobile Telecommunications Corp., Ltd,is prohibited from participating, or
entrusting others to participate or guiding the participating team.
• Notification and communication: The committee will invite teams to participate in
sharing seminar, awards ceremony and other activities through the contact information
reserved by the participating teams. If the participating team does not reply within 3 days
after the above-mentioned related notice is issued, it will be deemed to have automatically
given up the corresponding opportunity, and the organizer has the right to replace other
participating teams in order.
◼ Rights and Responsibilities
• The committee has the right to judge and dispose of cheating in the competition.
• The organizing committee reserves the right to modify the submission deadline, defense
date and awards date of the competition works. The organizing committee reserves the right
to suspend or terminate the competition under special conditions.
• The organizing committee reserves the right to withdraw or refuse awards to participating
teams that affect the organization and fairness of the competition.
• In case of data update, review code update, cheating check and other reasons, the committee
has the right to re-evaluate the results of the competition and update the rankings.
• The committee reserves the right to adjust and modify the rules of the competition. The
organizers of the competition have the final right to interpret the competition.
◼ Organization
Host - Guangdong OPPO Mobile Telecommunications Corp., Ltd
Platform - DataFountain
◼ Committee
Chairman:
Ning Yang Head of the OPPO Standard and Research Department
Professorate Senior Engineer, OPPO Research Institute
Shi Jin Vice President of Southeast University
Professor, Southeast University
Chairman of Technical Committee:
Zhaoyang Zhang Leader of the IMT-2030 Wireless AI Work Group
Professor, Zhejiang University
Xiaofeng Liu Leader of the IMT-2020(5G) Promotion Group 5G+AI Work Group,
Professorate Senior Engineer, China Academy of Information and
Communications Technology,
Feifei Gao Associate Professor, Tsinghua University
Jia Shen Vice-Leader of the IMT-2020(5G) Promotion Group 5G+AI Work
Group
Professorate Senior Engineer, OPPO Research Institute
Zheng Qin Director of Industry University Research Affairs Department, OPPO
Technology strategy and planning center
Technical Committee:
Caijun Zhong Professor, Zhejiang University
Jianhua Zhang Professor, Beijing University of Posts and Telecommunications
Lingyang Song Professor, Peking University
Wei Chen Professor, Beijing Jiaotong University
Wenchi Cheng Professor, Xidian University
Zhaocheng Wang Professor, Tsinghua University
Xiang Zhang Professorate Senior Engineer, China Academy of Information and
Communications Technology,
Zhi Zhang Communication Standards Expert, OPPO Research Institute
Technical Working Group:
Wenqiang Tian, Han Xiao, Wendong Liu, Dexin Li
◼ Contact
Tel: 010-62381637
Email: [email protected]
Community:
Official WeChat Communication Group:
Official WeChat Group: OPPO 6G AI Competition Communication Group
Official WeChat Account: (Continue to release contest-related information)
Competition Topic: AI-based Channel Modeling and Generating
Background
As the basis of wireless communication system design and performance evaluation, channel
modeling has attracted lots of attentions in the 6th generation (6G) pre-research. There are various
channel modeling approaches that have been proposed. However, considering the increasing
complexity of wireless environments, the extension of frequency band and the introduction of large-
scale multiple-input multiple-output (MIMO) systems, current channel modeling schemes are
difficult extracting the complicated wireless characteristics effectively. Recently, deep learning (DL)
based wireless communication has been regarded as a potential technology in the 6G. In addition to
accurate channel modeling, DL-based wireless communication approaches also require amounts of
high-quality wireless channel dataset to support the training of neural network (NN). However, the
collection of large wireless channel data is quite costly and time-consuming, which motivates novel
channel data generating solutions to support the training of NN. Therefore, to solve these problems,
the first 6G AI competition will take ‘AI based Channel Modeling and Generating‘ as the topic to
explore possible solutions.
Task
As shown in Fig. 1. The task considers utilize AI based method to realize the big set of wireless
channel data generation which is seeded from a small set of real channel data. The similarity and
diversity of the generated data are jointly used to perform the evaluation, in more detail:
a. Given a small set of real channel data, contestants design the AI based method to realize the
big set of wireless channel data generation which is seeded from the small real channel set.
b. The similarity between the distributions of the generated dataset and the real dataset is
evaluated.
c. Diversity of the generated dataset is evaluated.
d. The design and evaluation are performed on two types of real channel datasets, where the
complexity of the second type of channel is higher than that of the first type of channel.
Fig. 1 Illustration of competition task
Dataset
The competition provides two types of real datasets, i.e., H1_32T4R.mat with 500 samples and
H2_32T4R.mat with 4000 samples, in which the samples are full MIMO channel tensors with the
form of complex numbers and the shape of Nreal (number of samples)× 4 (receiving antennas) ×
32 (transmitting antennas) × 32 (delay paths).
Direct or indirect use of external datasets or pre-trained models are not allowed. After
the online evaluation phase, it is necessary for the winning teams to illustrate the training
process during the reviewing phase. The reproduce of training process will be conducted if
necessary. In the event of non-reproducible performance, illegal use of external data, etc., the
results will be cancelled.
Result Submission
Contestants should design the model according to the following rules, and upload the zip
package of the model to the scoring system of the competition platform.
Recommended programming language version: Python 3.7,
Recommended package version: tensorflow 2.4.2(2.1.0+), pytorch>1.7.0, Numpy 1.18.1, h5py
2.10.0,
Maximum upload file size: 400MB,
Maximum data generation time: 400s.
The scoring system supports the submission of model using TensorFlow or Pytorch. We
provide the reference code generatorFun.py and evaluation.py for both versions, where
1. generatorFun.py: Contains the functions of generator_1 and generator_2 for the two types
of channels, respectively, which are evaluated on the platform. Specifically, the inputs of the
function include the number of generated data, the generator model file and the real channel
dataset file. The output is the generated channel set with corresponding number samples.
2. evaluation.py: For evaluation offline. The code calls the functions generator_1 and
generator_2 defined in generatorFun.py and generate channel data fake_1 and fake_2
respectively, which are used to compare with real data and evaluate the performance and
score of the generated data (online evaluation will use independent real datasets) )
Files need to be submitted:
1.generatorFun.py (for TensorFlow) or generatorFun.py(for Pytorch)
2.generator_1.h5 (for TensorFlow) or generator_1.pth.tar(for Pytorch)
3.generator_2.h5 (for TensorFlow) or generator_2.pth.tar(for Pytorch)
Submission Example
Zip the files with the following structure, name the zip package with the ID of the team and
upload it, i.e.,
123456.zip
┣━ generatorFun.py (for TensorFlow) or generatorFun.py(for Pytorch)
┣━ generator_1.h5 (for TensorFlow) or generator_1.pth.tar (for Pytorch)
┗━ generator_2.h5 (for TensorFlow) or generator_2.pth.tar (for Pytorch)
Score
1. Contestants need to train the models on two types of real datasets respectively and submit
to the platform. Different schemes can be designed for different real datasets. There are no
restrictions on the scheme design for the first type of channel, while the scheme design for the
second type of channel is limited to the deep learning based generating model, e.g., generative
adversarial network, variational autoencoder, etc.
2. For each type of channel, the similarity between the distribution of the generated data set
and the total real data set is evaluated by
𝑠𝑖𝑚 = 1
𝑁𝑓𝑎𝑘𝑒∑ max
1≤𝑖≤𝑵𝑟𝑒𝑎𝑙
‖𝒉𝑗H𝒉′𝑖‖
2
‖𝒉𝑗‖2
‖𝒉′𝑖‖2
𝑁𝑓𝑎𝑘𝑒
𝑗=1
where Nfake denotes the number of generated channel samples, Nreal denotes the number of real
channel samples, 𝒉𝑗 and 𝒉′𝑖 denote the vectorized j th generated channel sample and i th real
channel, respectively. For the first type of channel, Nfake =10000 and Nreal=10000. For the second
type of channel, Nfake =40000 and Nreal=40000.
3. For each type of channel, the diversity of the generated channel is evaluated by
𝑚𝑢𝑙𝑡𝑖 = √Var(𝒍)
where Var(·) calculates the variance of the input vector. The element 𝑙𝑖0 of 𝒍 = [𝑙1, 𝑙2, ⋯ , 𝑙𝑁𝑟𝑒𝑎𝑙
]
is defined as
𝑙𝑖0= 𝑁 (argmax
1≤𝑖≤𝑵𝑟𝑒𝑎𝑙
‖𝒉𝑗H𝒉′𝑖‖
2
‖𝒉𝑗‖2
‖𝒉′𝑖‖2= 𝑖0)
where N(·) denotes the total number of fake samples whose most similar real sample is the given
i_0 the real sample
For the first type of channel, Nfake =10000 and Nreal=10000. For the second type of channel, Nfake
=40000 and Nreal=40000.
4. Scoring
The first dataset The second dataset
Valid Score sim1>0.2 and multi1/sim1<20 sim2>0.1and multi2/sim2<40
Score score1=(20-multi1/sim1)/ 20 score2=(40-multi2/sim2)/40
Final Score score_final=(score1+score2)/2
Note1: sim1, multi1, sim2, multi2 and score_final are displayed on the scoring platform and ranking
is according to score_final.
Note2: score1=0 if score1 is invalid, score2=0 if score2 is invalid.