Vol. 35, No. 1 (2019)
The DARPA SC2 Colosseum Test Bed
Exemplifying its focus on making critical contributions to critical challenges, the Johns Hopkins University Applied Physics Laboratory (APL) is pleased to present this issue describing the Colosseum—the first-of-its-kind wireless communication test bed that APL developed for the Defense Advanced Research Projects Agency (DARPA) Spectrum Collaboration Challenge (SC2). This test bed enables research into artificial intelligence and machine learning for networked systems—systems that autonomously negotiate use of the RF spectrum in real time based on instantaneous user demand, available spectrum, and environmental conditions. Through this effort, APL has provided a new capability enabling research beyond constrained RF allocations, ultimately contributing to improved resilience of networked systems on the battlefield.
In This Issue
Defense Advanced Research Projects Agency Spectrum Collaboration Challenge at APL: Introduction
With the emergence of fifth-generation (5G)-cellular and Internet of Things technologies, alongside legacy wireless systems, the radio frequency (RF) spectrum is becoming heavily congested, creating availability and throughput challenges for wireless service providers as well as our military forces. In addition to the congestion, our forces face threats from advanced jamming and cyberattack. This competition for use and control of the RF spectrum is one of the critical challenges facing the nation. Exemplifying its focus on making critical contributions to critical challenges, the Johns Hopkins University Applied Physics Laboratory (APL) is pleased to present this issue of the Johns Hopkins APL Technical Digest. The issue describes the Colosseum—the first-of-its-kind wireless communication test bed that APL developed for the Defense Advanced Research Projects Agency (DARPA) Spectrum Collaboration Challenge (SC2). This testbed enables research into artificial intelligence and machine learning for networked systems—systems that autonomously negotiate use of the RF spectrum in real time based on instantaneous user demand, available spectrum, and environmental conditions. Through this effort, APL has provided a new capability enabling research beyond constrained RF allocations, ultimately contributing to improved resilience of networked systems on the battlefield.
Overview of the Colosseum: The World’s Largest Test Bed for Radio Experiments
As fifth-generation (5G) cellular technology emerges, it is apparent that the radio frequency (RF)spectrum is constrained by the ever-growing demands of application bandwidth and the number of devices vying for that bandwidth. Databases and procedures for managing the spectrum have become very complex and do not scale to meet today’s on-demand spectrum requirements. In pursuit of novel methods to overcome these limitations, the Defense Advanced Research Projects Agency (DARPA) launched the Spectrum Collaboration Challenge (SC2) in 2016. The goal of the challenge, which culminated with the third and final competition in the fall of 2019, was to inspire participants to research, develop, and systematically test artificial intelligence algorithms across a network of radios to find the future paradigm for ensuring that the RF spectrum can support the bandwidths that next-generation applications will require. In support of SC2, the Johns Hopkins University Applied Physics Laboratory (APL) designed, developed, and hosted the Colosseum, the first-of-its-kind wireless research test bed in which competitors tested their algorithms and conducted their experiments in competition events. In addition to introducing SC2 and its goals, this article briefly describes the test bed architecture and the challenge events.
Software Project Management for the Defense Advanced Research Projects Agency Spectrum Collaboration Challenge
Development and management of the Colosseum, the wireless communications research test bed for the Defense Advanced Research Projects Agency (DARPA) Spectrum Collaboration Challenge (SC2),was a complex undertaking. With its world-class expertise in communication systems and experience in information technology infrastructure, the Johns Hopkins University Applied Physics Laboratory(APL) was well positioned to design, host, and maintain the Colosseum on its Laurel, Maryland, campus from 2016 to 2019. The effort required close coordination among members of the APL team and between APL and DARPA. To effectively and efficiently manage the design and maintenance of the Colosseum, APL applied tested project management tools and techniques, a development and operations approach, and an agile framework. This article focuses on the early planning and initial development efforts and documents the project management attributes, including the composition of the APL team as well as the software tools, that contributed to the success of the effort.
Development and Operations on the Defense Advanced Research Project Agency’s Spectrum Collaboration Challenge
The Johns Hopkins University Applied Physics Laboratory (APL) developed a complex test bed of software and hardware called the Colosseum to support the Defense Advanced Research Projects Agency (DARPA) Spectrum Collaboration Challenge (SC2). Following a development and operations (DevOps) approach was critical to the team’s ability to design and build the Colosseum. Such an approach enhances collaboration between operations and development teams and takes advantage of technology, particularly automation tools. Tasks for the DevOps team included developing software codebases, deploying system configurations, and monitoring hardware system status such as power levels, system temperature, fans, and system uptime. The team accomplished these tasks by following a DevOps approach and using a variety of toolsets. This article describes the processes and tools the team used to design, build, and maintain the Colosseum.
The Resource Manager for the Defense Advanced Research Projects Agency Spectrum Collaboration Challenge Test Bed
A key component of success in the Defense Advanced Research Projects Agency (DARPA) SpectrumCollaboration Challenge (SC2) was ensuring that each competitor had fair access to thelimited physical resources available in the competition. The Johns Hopkins University AppliedPhysics Laboratory (APL) designed and developed a custom Resource Manager as part of the Colosseum,the wireless research test bed at the foundation of the SC2 competition. By allocatingresources through a token system, the Resource Manager ensured that competitors had fair andequal access to resources in the Colosseum. The Resource Manager also provided mechanismsfor automated experiment handling and orchestration that increased the scheduling efficiencyof the resources and gave competitors equal access to all 128 nodes in the Colosseum. From 2016to 2019, the Resource Manager maintained continuous availability of Colosseum resources thatenabled international competitors to develop new artificial intelligence algorithms for radio frequency(RF) spectrum management.
Standard Radio Nodes in the Defense Advanced Research Projects Agency Spectrum Collaboration Challenge
One of the major constructs of the Defense Advanced Research Projects Agency (DARPA) SpectrumCollaboration Challenge (SC2) framework was the standard radio node (SRN). The Johns Hopkins University Applied Physics Laboratory (APL) designed the Colosseum, the massive wirelesstest bed behind SC2, and the SRN within it. The SRN provided SC2 competitors a software-definedradio (SDR) as well as compute and storage node resources so that they could develop, test, anddemonstrate collaborative intelligent radio network (CIRN) solutions. The SRN was designed todynamically allocate and de-allocate competitors’ container images while providing them completeaccess to and control of physically attached SDR and network resources. The SRN ensured the competition’s security, integrity, and fairness and isolated each competitor’s files and software. This article discusses the SRN’s architecture and its supporting and commanding systems, including locally managed services and processes.
Incumbent Radio Systems in the Defense Advanced Research Projects Agency Spectrum Collaboration Challenge Test Bed
The application of artificial intelligence and machine learning promises to usher in a new paradigm for emerging wireless communication systems. The goal of the Defense Advanced Research Projects Agency (DARPA) Spectrum Collaboration Challenge (SC2) was to push this new paradigm forward. However, legacy radio systems already in place, such as radars for weather monitoring, receivers for spectrum monitoring, and battlefield jammers, will remain in use for a long time. Therefore, intelligent radios must operate around and adapt to these legacy systems to avoid interfering with them. In support of DARPA’s SC2, the Johns Hopkins University Applied Physics Laboratory(APL) designed and built a wireless research test bed, referred to as the Colosseum, whereSC2 competitors could test and develop solutions to enable this new communications paradigm. A critical component of the Colosseum was its legacy radio emulators, referred to as Colosseum incumbents, that represented today’s systems. These incumbents emulated the radio frequency(RF) behavior of existing real-world radio systems, serving as RF obstacles that SC2 competitors had to detect and work around while simultaneously administrating their own communications for maximum data throughput efficiency.
Traffic Generation System for the Defense Advanced Research Projects Agency Spectrum Collaboration Challenge
The Defense Advanced Research Projects Agency (DARPA) Spectrum Collaboration Challenge(SC2) required competitors to develop shared spectrum solutions for next-generation communication systems. To enable competitors to test their designs and DARPA to measure and evaluate their utility, the Johns Hopkins University Applied Physics Laboratory (APL) designed and built a wireless research test bed called the Colosseum. One of its components, the Traffic Generation System, enabled on-demand generation and logging of Internet Protocol (IP) version 4 (IPv4) traffic in the Colosseum. The Traffic Generation System simulated a set of network applications running simultaneously on a group of peer nodes, such as a video conferencing application connecting four participants. The Traffic Generation System provided a continuous and unpredictable stream of traffic so that competitors could be measured against a maximum expected traffic flow transmitted through their radios with no possibility of gaining an unfair advantage. IP traffic provides good evaluation metrics because IP packets can be counted, and statistics such as data throughput, latency, jitter, and loss can be calculated. This article discusses the software, hardware, and networking design of the Traffic Generation System.
Radio Frequency Emulation System for the Defense Advanced Research Projects Agency Spectrum Collaboration Challenge
The Johns Hopkins University Applied Physics Laboratory (APL) designed and built a wireless communications research test bed, called the Colosseum, for the Defense Advanced Research Projects Agency (DARPA) Spectrum Collaboration Challenge (SC2). SC2 aimed to motivate research into autonomous wireless communication systems to uncover a new paradigm for managing the oversubscribed radio frequency (RF) spectrum. This article describes the Colosseum’s RF Emulation System, which mimicked real-world phenomenon such as propagation delay, Doppler shift, and power attenuation between 128 two-channel radios, or 65,536 wireless communications channels. The RF Emulation System emulated isolated virtual environments across multiple concurrent experiments, enabling challenge competitors to research, develop, and test next-generation artificial intelligence solutions for wireless network systems.