有料盒子APP

有料盒子APP insights about AI-powered sensemaking

Sensemaking Reimagined

VELOCITY V3. 2025 | Don Polaski, Marissa Beall, and Christopher Castelli

See how next-gen systems can outpace urgent threats

At dawn, Grace, an all-source intelligence analyst for a three-letter agency, logs in to her workstation at headquarters. From her desk inside the Beltway, she turns her top-secret gaze to the Indo-Pacific region, half a world away. It鈥檚 the same routine she鈥檚 had for three years in the role. But this morning, February 3, 2027, is different. She sees an urgent email from her supervisor. What comes next, she can鈥檛 stop. All at once, her brows arch up, her eyes widen, her jaw drops, and she gasps.听聽

The headline is clear: 鈥淐hina Buys Uninhabited Fijian Island to Build Military Base.鈥 The news comes from the Beijing bureau of a major U.S. daily. 鈥淎 Chinese development firm with links to the Chinese government and People鈥檚 Liberation Army today announced that it recently purchased the uninhabited Cobia Island from the government of Fiji for $850 million,鈥 the story says. 鈥淲estern security analysts assess that China plans to use the island to build a permanent military base in the South Pacific, 3,150 miles southwest of Hawaii.鈥

The news means the People鈥檚 Republic of China (PRC) can boost its power projection in the Pacific Islands, a region of strategic importance, expanding the presence of its military鈥攖he People鈥檚 Liberation Army (PLA)鈥攏ear U.S. and Australian soil.

It鈥檚 the kind of surprise that Grace and her intelligence community (IC) colleagues always try to avoid. They know in their gut they must focus on hard targets to collect information on adversary plans that would otherwise go undetected, just as a聽. A聽聽is 鈥渁 person, nation, group, or technical system鈥 that poses a potential threat and a very difficult intelligence-gathering challenge鈥攊t鈥檚 鈥渙ften hostile to the U.S. or heavily protected, with a well-honed counterintelligence capability.鈥 In this case, the PRC succeeded in keeping the U.S. in the dark.

鈥淚t鈥檚 why we call it the pacing challenge,鈥 Grace tells herself half-heartedly. It鈥檚 no consolation.

The Truth in the Fiction

This imaginary scenario starts with a fictional headline borrowed from a . Behind our invented scene is the IC鈥檚 real need to get ahead of surprises by accelerating its ability to collect, analyze, and make sense of vast amounts of data. This challenge is intensifying as the number and quality of sensors rise around the world.

Although Grace鈥檚 gaze is set on the Indo-Pacific, no foreign power has a monopoly on inscrutability. Decades ago, Winston Churchill of forecasting Russian actions as 鈥渁 riddle wrapped in mystery inside an enigma鈥濃攁nd that still sounds about right. To address the full range of national security challenges around the world, IC analysts and warfighters need to make sense of complex, uncertain situations鈥攁nd to do that, they need sensemaking systems that can collect and analyze data on an exponentially increasing scale.

Grace is a stand-in for real all-source analysts tasked with monitoring PRC foreign influence. All-source analysts review and analyze all kinds of data to assess, interpret, forecast, and explain a range of national security issues and developments that are regional or functional in nature. They use the full complement of all-source tools, techniques, and procedures to fuse all available intelligence into a comprehensive product designed to satisfy unit-level essential elements of information (EEI) and command-level priority intelligence requirements (PIR).

Sensemaking is the fundamental cognitive ability human analysts use to understand emerging developments and anticipate future events. It鈥檚 not the work of a lone analyst but happens with the fusion of many viewpoints. Increasingly, technology plays a supporting role. A decade after the 9/11 attacks, the Intelligence Advanced Research Projects Activity (IARPA) as 鈥渢he remarkable human ability to detect patterns in data, and to infer the underlying causes of those patterns鈥攅ven when the data are sparse, noisy, and uncertain.鈥 IARPA also called for the development of new automated analysis tools designed to replicate the strengths of this ability. A 2019 IC strategy for augmenting intelligence using machines defined sensemaking as 鈥渁 process of creating understanding in situations of high complexity,鈥 urging the construction of shared models 鈥渢o provide the basis for trust between human and machine teams.鈥

Had the team in our hypothetical scenario been able to comb through vast amounts of data more efficiently and effectively, they might have uncovered the brewing PRC-Fiji deal earlier, enabling the U.S. to proactively manage related risks and perhaps even shape the outcome.

In this first version of the story, the sensemaking capabilities at the team鈥檚 disposal aren鈥檛 as robust as they need to be. The IC is still moving from counterterrorism-focused approaches to the new technical capabilities designed for collection and analysis against hard targets and the pacing challenge. Now let鈥檚 reimagine our scenario, but this time with transformed sensemaking systems already in place.

Sensemaking Reimagined

Rewind six months. Grace is sitting across from her supervisor in a nondescript meeting room at headquarters. An initial review of collected signals carried out by a finetuned large language model (LLM), a type of artificial intelligence (AI), has triggered a high alert involving hard targets. Now human analysts need to investigate.

鈥淭he PLA and this development firm are talking. No idea why,鈥 the supervisor says, pushing a file to Grace. 鈥淲e need to identify any potential operations. That鈥檚 where you come in.鈥

Grace looks at the photos. The development firm is led by a notorious 鈥渞etired鈥 PRC intelligence officer, a very slippery target indeed鈥攔arely seen, never overheard. The other few targets are PLA leaders who work in highly secure facilities.

鈥淵ou鈥檒l also have access to these resources,鈥 the supervisor adds, listing tools with sensitive, unrepeatable names. The conversation doesn鈥檛 dwell on how the tools include new algorithms to strengthen collection, more powerful sensors with greater analytic power at the edge, computer vision models for capturing new objects or performing change detection in key areas, LLM agents to ease the challenge of sifting through massive amounts of data, and analytics services that fuse commercial signals and satellite imagery. At this moment, all that matters is the tools will help Grace and her team rapidly collect the right data and connect the dots. The tools will quickly synthesize the data, present options to analysts, and operate as assistants.

For the intelligence collection, Grace targets key individuals, their organizations, and relevant technical systems (e.g., devices and equipment used by the targets). Weeks go by. They meet again in a hurry when Grace reports a breakthrough. Several targets are talking to each other about Fiji, with one even naming a specific location: Cobia Island. Shaped like a crescent moon and lined with tall trees, the island is a submerged volcanic crater. Intrepid tourists visit for hiking, snorkeling, and kayaking.

鈥淢aybe the PLA would rather park warships there,鈥 the supervisor says. 鈥淲e鈥檒l need new overhead satellite imagery.鈥 The team assembles more collection plans and starts putting them into action. As it turns out, the AI assistant has already anticipated the need, and has ordered and received commercial satellite imagery of the island. But there is a brief setback, a glitch.

In the overhead imagery, the surrounding waters are clear, but part of the island keeps coming back fuzzy, almost like it鈥檚 camouflaged. Maybe it isn鈥檛 a glitch. Computer vision analyzes the pixels and Grace adjudicates. The target becomes just clear enough to confirm someone is skillfully hiding something. But what?

Grace turns to a teammate, Connor, a collection manager who helps all-source analysts get the intelligence data they need to answer key intelligence questions. Seeing the need to collect more imagery along with electronic signatures in the area, Connor tasks a drone to get a better look from multiple angles.

The new 3D imagery arrives. Grace opens the file. All at once, her brows arch up, her eyes widen, her jaw drops, and she gasps.

鈥淎ha!鈥 A new structure is hidden in the breathtaking beach forest. The building has an uncommon design. The footprint is relatively small but perhaps the start of something bigger. What鈥檚 more, there are signs of a recent oil or chemical spill at the site. It鈥檚 unclear if the people there have noticed the spill yet. Even if they have, they may not know the contamination is spreading behind the structure down to the white sands and crystal waters.

Delving deeper, the team uses machine learning (ML) algorithms to parse signals from the area to see if they can be tied to known actors. The results show personnel from the shadowy development company are likely at the site. These people are overheard saying the PRC plans to buy the island. Grace鈥檚 supervisor is elated.

鈥淚f I was a citizen of Fiji, I鈥檇 want to know about pollution threatening the pristine environment,鈥 the supervisor says. 鈥淕reat work.鈥 Somehow, leaders in Fiji鈥檚 tourism industry and environmental community soon learn there鈥檚 been a spill on the island. Before the PRC-backed development firm can close a deal to buy the island, the public in Fiji voices strong concern, changing the calculus for Fiji鈥檚 government, which no longer feels comfortable making a sale. What鈥檚 more, the team鈥檚 work has established a pattern of life for the collection targets. In the future, the IC can use this pattern to identify and get ahead of similar risks elsewhere in the region.

The need for next-generation sensemaking isn't over the horizon鈥攊t's urgent.

Transforming Sensemaking Capabilities

This is just one hypothetical scenario involving hard targets. Others might look very different. The need to identify, analyze, and track emerging developments around the world is urgent. The U.S. military鈥檚 Joint All-Domain Command and Control (JADC2) strategy prioritizes sensemaking to turn data into information and information into knowledge through 鈥渢he ability to fuse, analyze, and render validated data and information from all domains and the electromagnetic spectrum.鈥 In the unfortunate event of a military crisis or conflict, sensemaking capabilities would rapidly scale in certain ways. But there is no time to wait. More and more, threats from nation-states are taking the shape of coercive or subversive actions below the threshold of armed conflict. Scaling and strengthening sensemaking capabilities now is crucial for national security and global stability.

Overall, the IC needs to adopt, buy, or build the right technology to transform their sensemaking capabilities so they can collect against and analyze hard targets despite advanced adversarial surveillance and counterintelligence capabilities. The nature of near-peer conflict makes this continued modernization all the more difficult. These systems and advanced analytics need to work in disrupted, disconnected, and intermittent low-bandwidth (DDIL) environments. These constraints require new approaches for development and operations. For instance, a using forward collection teams to push AI-enabled collection and analysis closer to operators in contested areas. Pushing these capabilities to the edge is essential for maintaining the advanced analytics required, even as adversaries work to disable U.S. mission systems.

In addition, the IC needs scalable systems with more computing power than ever before to churn through data and prepare insights for policymakers and warfighters. Otherwise, because current manual systems only let teams analyze so much data at a time, intelligence is left on the table鈥攁nd that intelligence could potentially be decisive in a crisis or conflict. Imagine, then, the national security value of having algorithms parsing through vast amounts of data and accurately alerting scientists to information of interest for further investigation.

But this isn鈥檛 just about technology. What鈥檚 needed is comprehensive modernization across the enterprise, including strategy, governance, culture, talent, data, technology, and IT processes. To that end, the Defense Innovation Board has recommended 鈥渁ligning incentives to drive faster tech adoption鈥 by embracing risk, providing 鈥渢op cover,鈥 stopping the tendency to reward mediocrity, accelerating innovation and tech development, creating a career path for innovators, tracking people innovation readiness levels, defining a vision for innovation, and creating a culture of learning and innovation.

By pursuing mission-driven innovation, your organization can focus not just on quickly buying the latest tech but on accelerating mission outcomes. You can more rapidly adopt key technologies that address current and expected requirements, maximize the likelihood that investments will lead to the fielding of suitable and effective capabilities at mission speed, factor in tradecraft and workflow considerations from the start, proactively consider the ability to scale over time and meet future processing needs, and mitigate the risk that fielded capabilities will quickly become obsolete.

The Defense Innovation Board called for a better understanding of how industry works, greater business acumen, and tighter collaboration with providers of cutting-edge tech. Industry partners who bring a mix of deep mission understanding and key connections with other leading providers of crucial tech鈥攆or example, cloud computing, AI, and ML鈥攃an enable the IC to create more resilient and responsive sensemaking at scale. Imagine, for instance, onboarding hundreds of new models to augment and improve tradecraft, delivering a clear advantage to policymakers as well as personnel in the field.

The need for next-generation sensemaking isn鈥檛 over the horizon鈥攊t鈥檚 urgent. Then- how well or how poorly the agency leverages emerging tech and transforms its tradecraft鈥攖o stay ahead of adversaries鈥攚ill 鈥渕ake or break us as a professional intelligence service.鈥 The same holds for the IC as a whole. It鈥檚 time to take action. Together, the IC and industry can address this challenge. To start creating next-generation sensemaking systems today, your organization can take the following three steps.

3 Steps to Create Next-Generation Sensemaking Systems Now

1. Advance

  • Assess your current state and build a roadmap. Use a holistic framework that empowers organizations to understand, grow, and reinforce their analytics capability. Identify strengths, gaps, and needs across multiple areas, including strategy, governance, culture, talent, data, technology, and IT processes. Build scorecards to prioritize areas for modernization. Develop and release a strategic vision for modernization. Include clearly defined, achievable goals and success metrics. Assess the maturity of current zero trust cybersecurity capabilities. Build a modernization roadmap with necessary actions, timelines, and resources to meet short-term and long-term modernization goals with measurable results.
  • Focus on data. Data is key for sensemaking. Modernize back-end data storage technology for a legacy system to improve data management, integration across stovepipes, accessibility, and availability, and to enable ML workflows.
  • Enable ML operations. Expand on modern data architecture and data-mesh concepts to set up ML pipelines for predictive modeling with continuous evaluation. Evaluate best-in-class foundation models to synthesize large amounts of data. Establish processes to enable multiple models to pick the right tool for the right job. Don鈥檛 put all your eggs in one basket. Be ready to constantly update. An example of a success metric would be 鈥渁chieve 98% data availability.鈥
  • Leverage leading DevOps tools. Use a deployment framework that includes opensource clusters for hosting containerized software. Establish AI-enabled development environments with low-to-high continuous deployment pipelines to increase velocity and agility. Include program health monitoring and metrics.
  • Leverage HCD. Apply human-centered design (HCD) principles to understand how solutions will fit into intelligence analyst workflows. Verify solutions augment and enhance existing analyst workflows.

2. Activate

  • Conduct pilot modernization efforts. Include change management activities. Maximizing the understanding, willingness, and capability of the workforce to move from the current state to the future state is crucial for risk management. Identify a system or process to execute modernization on. Start with something that is limited in scale and noncritical.听
  • Start modernization. Conduct modernization activities on the selected system/process. Align success criteria to real mission impacts, focusing not on the technology but on what that technology enables. Focus on iterative delivery and integration into the mission. Highlight mission outcomes and measurable impacts for key stakeholders. Provide training and engage users. Document new tradecraft and workflows. Informed by the earlier assessment, adopt zero trust capabilities to enable data-centric security, data sharing across security enclaves, and greater interoperability. Share the results with key stakeholders. If, for instance, you succeed in modernizing your infrastructure to do advanced analytics at scale, leadership will likely want to know.
  • Introduce digital assistants. Introducing AI-enabled digital assistants to supercharge analyst productivity is an example of potential modernization activities. Build them into common working environments and workflows to proactively pull in applicable research and provide preliminary analysis so humans can focus on higher value activities.

3. Accelerate

  • Scale modernization efforts. Modernize critical systems and infrastructures iteratively. Measure and monitor performance and optimize. Develop documentation and enable knowledge sharing. Standardize tradecraft and workflows for accomplishing the mission across the organization. Continue user engagement, feedback, and integration activities. Across all phases, maintain clear and consistent communication and manage expectations. Be prepared to adapt the roadmap based on new insights, and manage and alleviate risks.
  • Build AI agent functionality. This is an example of scaling modernization. Prototype and begin phasing in AI agent functionality that can autonomously鈥攚ith supervision鈥攃omplete routine intelligence workflows by interacting with knowledge bases, tools, and external systems to meaningfully increase productivity, efficiency, and time to insight.

Key Takeaways

  • To address urgent national security challenges around the world, intelligence community (IC) analysts and warfighters need to make sense of complex, uncertain situations鈥攁nd to do that, they need next-generation sensemaking systems that can collect and analyze data on an exponentially increasing scale.
  • These tools can quickly synthesize data, present options to analysts, and operate as assistants. Imagine, for instance, new algorithms designed to strengthen collection, more powerful sensors with greater analytic power at the edge, computer vision models for capturing new objects or performing change detection in key areas, large language model (LLM) agents to ease the challenge of sifting through massive amounts of data, and analytics services that fuse commercial signals and satellite imagery.
  • It鈥檚 time to take action. Organizations can create next-generation sensemaking systems now by assessing the current state and building a roadmap, undertaking pilot modernization projects, and accelerating modernization at scale.

Meet the Authors

Don Polaski

is a leader in 有料盒子APP鈥檚 national security sector focused on developing AI and data science solutions that drive mission outcomes at speed and scale.

Marissa Beall

is a data scientist focused on applying AI and advanced, multi-INT analytics to transform national security missions and tradecraft.

Christopher Castelli

is a zero trust industry engagement lead in 有料盒子APP鈥檚 national cyber business focused on security challenges and solutions.

References
  • 鈥淭he ADAPT+C Framework,鈥 有料盒子APP Hamilton, accessed October 29, 2024, /s/solution/the-adapt-c-framework.html.
  • Brian Katz, Maintaining the Intelligence Edge: Reimagining and Reinventing Intelligence through Innovation, Center for Strategic and International Studies, January 13, 2021, .听
  • Carmen Medina and Rebecca Fisher, 鈥淲hat the World Economic Crisis Should Teach Us,鈥 Studies in Intelligence 53, no. 3 (September 2009): 11鈥16, .听
  • Defense Innovation Board, Aligning Incentives to Drive Faster Tech Adoption, accessed October 29. 2024, .
  • Department of Defense, Summary of the Joint All-Domain Command and Control (JADC2) Strategy, March 2022, .
  • 鈥淓nabling Mission-Critical Machine Learning,鈥 有料盒子APP Hamilton, accessed October 29, 2024, /d/insight/thought-leadership/enabling-mission-critical-machine-learning.htm.
  • 鈥淚CArUS: Integrated Cognitive-Neuroscience Architectures for Understanding Sensemaking,鈥 Intelligence Advanced Research Projects Activity, accessed October 29, 2024, .
  • Joseph W. Gartin, 鈥淟ooking Ahead: The Future of Analysis,鈥 Studies in Intelligence 63, no. 2 (June 2019): 1鈥6, .
  • National Intelligence Council, Global Trends: Paradox of Progress, January 2017, .
  • Office of the Director of National Intelligence, The AIM Initiative: A Strategy for Augmenting Intelligence Using Machines, accessed December 2, 2024, .
  • Office of the Director of National Intelligence, 鈥淭erms & Definitions of Interest for DoD Counterintelligence Professionals,鈥 May 2, 2011, .
  • 鈥淨uotes: Russia,鈥 The International Churchill Society, accessed June 24, 2023,
  • William Burns, 鈥淔ireside Chat with William Burns: Aspen Security Forum 2023,鈥 interview by Mary Louise Kelly, July 20, 2023, posted by Central Intelligence Agency, .

VELOCITY MAGAZINE

有料盒子APP's annual publication dissecting issues at the center of mission and innovation.

Subscribe

Want more insights from Velocity? Sign up to receive more stories about emerging technologies and the impacts they鈥檙e making on missions of national importance.



1 - 4 of 4