-
Notifications
You must be signed in to change notification settings - Fork 107
/
2023-osint-trends-analysis.html
126 lines (110 loc) · 18.7 KB
/
2023-osint-trends-analysis.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
<!doctype html>
<html lang="en">
<head>
<!-- Required meta tags -->
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<!-- The page supports only a dark color schemes -->
<meta name="color-scheme" content="dark">
<meta name="title" property="og:title" content="MetaOSINT | 2023 OSINT Trends Analysis"/>
<meta name="type" property="og:type" content="website"/>
<meta name="image" property="og:image" content="https://raw.githubusercontent.com/MetaOSINT/MetaOSINT.github.io/main/assets/images/mo_blog_3_cropped.png"/>
<meta name="url" property="og:url" content="https://metaosint.github.io/2023-osint-trends-analysis.html"/>
<meta name="description" property="og:description" content='MetaOSINT enables open source intelligence ("OSINT") practitioners to jumpstart their investigations by quickly identifying relevant, publicly-available tools and resources, saving valuable time during investigations, research, and analysis.'/>
<meta name="author" content="TropChaud">
<meta name="twitter:card" content="summary"/>
<meta name="twitter:site" content="@IntelScott"/>
<meta name="twitter:title" content="MetaOSINT | 2023 OSINT Trends Analysis"/>
<meta name="twitter:description" content='MetaOSINT enables open source intelligence ("OSINT") practitioners to jumpstart their investigations by quickly identifying relevant, publicly-available tools and resources, saving valuable time during investigations, research, and analysis.'/>
<meta name="twitter:image" content="https://raw.githubusercontent.com/MetaOSINT/MetaOSINT.github.io/main/assets/images/mo_blog_3_cropped.png" />
<!-- Replace the Bootstrap CSS with the
Bootstrap-Dark Variant CSS -->
<link href="https://cdn.jsdelivr.net/npm/[email protected]/dist/css/bootstrap-night.min.css" rel="stylesheet">
<title>MetaOSINT | 2023 OSINT Trends Analysis</title>
<link rel="icon" type="image/x-icon" href="https://raw.githubusercontent.com/MetaOSINT/MetaOSINT.github.io/main/assets/images/MetaOSINT_favicon.png">
<style>
.social-icon {
text-align: center;
text-decoration: none;
fill: #c0c0c0;
}
</style>
</head>
<body>
<script async defer src="https://buttons.github.io/buttons.js"></script>
<div class="col" style="height:150px;width:60%;float:left">
<p style="text-align:right;padding:0px">
<a href="https://metaosint.github.io/"><img src="https://raw.githubusercontent.com/MetaOSINT/MetaOSINT.github.io/main/assets/images/metaosint_dark.png" alt="MetaOSINT" style="width:33%;max-width:283px"></a>
</p>
</div>
<div class="col" style="height:150px;width:40%;float:right;padding:20px 40px 0px 0px">
<p style="text-align:right">
<a class="nav-link" href="https://tropchaud.github.io/" target="_blank" style="text-decoration:none;padding:10px;font-size:16px">
<svg xmlns="http://www.w3.org/2000/svg" class="social-icon" height="18" width="18" viewBox="0 0 576 512"><!--!Font Awesome Free 6.5.1 by @fontawesome - https://fontawesome.com License - https://fontawesome.com/license/free Copyright 2024 Fonticons, Inc.--><path d="M384 480h48c11.4 0 21.9-6 27.6-15.9l112-192c5.8-9.9 5.8-22.1 .1-32.1S555.5 224 544 224H144c-11.4 0-21.9 6-27.6 15.9L48 357.1V96c0-8.8 7.2-16 16-16H181.5c4.2 0 8.3 1.7 11.3 4.7l26.5 26.5c21 21 49.5 32.8 79.2 32.8H416c8.8 0 16 7.2 16 16v32h48V160c0-35.3-28.7-64-64-64H298.5c-17 0-33.3-6.7-45.3-18.7L226.7 50.7c-12-12-28.3-18.7-45.3-18.7H64C28.7 32 0 60.7 0 96V416c0 35.3 28.7 64 64 64H87.7 384z"/></svg>
TropChaud's project portfolio
</a>
<a class="github-button" href="https://github.com/MetaOSINT/MetaOSINT.github.io" data-icon="octicon-star" data-show-count="true" aria-label="Star MetaOSINT/MetaOSINT.github.io on GitHub">Star</a>
<br>
<a class="github-button" href="https://github.com/MetaOSINT/MetaOSINT.github.io/fork" data-icon="octicon-repo-forked" data-show-count="true" aria-label="Fork MetaOSINT/MetaOSINT.github.io on GitHub">Fork</a>
</p>
</div>
<div class="col" style="margin-left:17%;margin-right:17%">
<p style="text-align:center;padding:185px 0px 0px 0px"><i>MetaOSINT recently received its largest update yet! Check out the <a href="https://metaosint.github.io/chart" target="_blank">chart</a> or <a href="https://metaosint.github.io/table" target="_blank">table</a> to explore thousands of newly tracked OSINT tools & resources.</i></p>
<h1>2023 OSINT Landscape Trends: A Data-Driven Analysis</h1>
<p><i>Published January 8, 2024 by <a href="https://tropchaud.github.io/about.html" target="_blank">TropChaud</a></i></p>
<a href="https://metaosint.github.io/chart" target="_blank"><img style="float:right;margin:10px;width:43%;border: 1px solid #f3f3f3" alt="MetaOSINT Interactive Chart" src="assets/images/mo_chart_full.png"/></a>
<p>In 2018, while conducting digital investigations in a former role, I started bookmarking lists of tools & resources useful for open-source intelligence (“OSINT”) research, including a surprising number of <i>lists of lists</i>. The collection grew, and after some (pretty painstaking) normalization efforts, I published the <a href="https://metaosint.github.io/" target="_blank">MetaOSINT</a> dataset & web app in 2021.</p>
<p>MetaOSINT is first & foremost a tactical aide, designed to help <a href="https://www.youtube.com/watch?v=pVYCKu42LAk" target="_blank">jumpstart OSINT investigations</a>. But after steadily gathering more tools & resources over nearly half a decade - a period that witnessed immense geopolitical, societal, and digital change & disruption - it seemed worthwhile to take a step back and survey how the dataset itself had changed, while considering what those changes might reflect about any broader trends.</p>
<p>This summary spotlights some of the most apparent changes I noticed in the makeup of the MetaOSINT dataset and quick takes on what those changes might suggest about the underlying landscape. It’s far from an academic assessment, but I haven’t seen a study quite like this conducted before - rooted in data points and at this scale, so I hope it adds value for more strategic-focused analysts and more tactical practitioners/investigators alike.</p>
<img style="float:left;margin:10px 25px 10px 0px;width:52%;border: 1px solid #0b5394" src="assets/images/mo_blog_2.png"/>
<h2 id="summary">There’s a Tool for That</h2>
<p>The number of tools & resources for conducting OSINT research - as measured by MetaOSINT - has grown considerably in recent years. In 2021, MetaOSINT tracked ~4,800 resources. ~1,000 were added in 2022, and the December 2023 update added a staggering 7,000 additional resources. These are certainly imperfect measures (especially considering that the <a href="https://metaosint.github.io/learn-more#methodology" target="_blank">inclusion methodology</a> evolved since launch), but the data presented here suggest the landscape has almost certainly seen considerable growth in recent times.</p>
<p>There are now more OSINT tools than ever, useful for a wide variety of applications. If you are trying to find some bit of information online, there is a really good chance that some resource exists to help you. MetaOSINT is designed to help you surface that resource quickly - use the <a href="https://metaosint.github.io/table" target="_blank">table</a> if you have a pretty clear focus, or the <a href="https://metaosint.github.io/chart" target="_blank">chart</a> to start more broadly.</p>
<br>
<h2 id="social-media">Social Media OSINT is on 🔥</h2>
<img style="float:right;margin:15px;width:36%;border: 1px solid #0b5394" src="assets/images/mo_blog_3.png"/>
<p>An immense number of tools & resources exists to support OSINT research on social media platforms, and recent years stand out for the sheer number, depth, and variety that have been shared. With the addition of nearly 1,800 resources since 2021, Social Media is now the top MetaOSINT <a href="https://github.com/MetaOSINT/MetaOSINT.github.io/blob/main/docs/categories.md" target="_blank">resource category</a>.</p>
<p>The boom in tools for social media OSINT likely parallels <a href="https://www.smartinsights.com/social-media-marketing/social-media-strategy/new-global-social-media-research/" target="_blank">continually growing social media use</a> in general, but I find it valuable to observe the scale of overall and especially specific changes. Trendlines for specific platforms are likely influenced by a number of factors, including usage in general, more or less OSINT value from particular sources, and/or ease or challenges in retrieving relevant data from each platform.</p>
<p>Most platforms saw a dramatic increase in the number of available OSINT tools, including Twitter/X, which retained the top spot by a healthy margin, more than doubling an already sizable number [note: most resources referenced here were likely published before changes to Twitter’s API took effect in Spring 2023].* Image- & video-forward platforms like Instagram, Snapchat, TikTok, and Twitch saw immense increases in the number of OSINT-related resources, as well as chat & messaging platforms like Telegram, Discord, and WhatsApp and dating sites (COVID-19 pandemic quarantines probably further influenced many of these trends, including the latter 😉). Type the name of any of these platforms as a keyword into the search bar on the <a href="https://metaosint.github.io/table" target="_blank">MetaOSINT table page</a> to instantly surface the range of OSINT resources related to it.</p>
<p style="font-size:12px">*<i>Reduced</i> category tallies (e.g. VKontakte/Russian-speaking social media) were typically caused by either my own cleanup of the original data, or efforts to keep the collection from getting too unwieldy. For the small number of cases where resources were possibly “cut” from MetaOSINT, I feel the benefits of the far-deeper 2023 dataset greatly outweigh these limited potential downsides.</p>
<h2 id="geopolitics">Conflict & Crisis OSINT</h2>
<br>
<img style="float:right;margin:15px;width:48%;border: 1px solid #0b5394" src="assets/images/mo_blog_4.png"/>
<p>The Geopolitics segment of tools & resources grew the most - by far - of any category since MetaOSINT launched. A huge volume of resources around the Russia-Ukraine war were added, related to all aspects of the conflict - certainly open-source tracking of military and logistical movements & activities (evidenced especially with growth in ship and plane identification & tracking/traffic services), but also new information & people searches focused specifically on the region. Some approaches to surfacing these in the <a href="https://metaosint.github.io/table" target="_blank">MetaOSINT table feature</a> include:</p>
<ul>
<li>Type the simple keywords “Russia” or “Ukraine” in the search bar to quickly start a broad lookup.</li>
<li>The “Maritime” and “Aviation” sub-categories within the “Transportation” category will surface a large number and variety of resources related to vessel identification & movement tracking.</li>
<li>Type “Russia Resources” to find an entire new, dedicated sub-category within the Identity/Person Search Category.</li>
<li>Another new sub-category, “Illicit Trade” (type that phase in the search bar), was added under the Geopolitics category in order to facilitate easier surfacing of this now-substantial segment of OSINT resources (over 100 are now currently tracked in MetaOSINT).</li>
</ul>
<br>
<p>Table search in action:</p>
<a href="https://metaosint.github.io/table" target="_blank"><img style="float:left;margin:10px 25px 10px 0px;width:51%;border: 1px solid #f3f3f3" src="assets/images/geopolitics_table.gif"/></a>
<p>The boom in OSINT applications for conflict & crisis tracking doesn’t come without limitations and potential downsides, and this <a href="https://reutersinstitute.politics.ox.ac.uk/news/israel-gaza-war-highlights-power-and-limits-open-source-reporting" target="_blank">timely Reuters Institute piece</a> summarizes several specific, critical considerations. It’s also well worth noting that the many resources recently added to MetaOSINT were compiled prior to the launch of the Israel-Hamas war in October 2023. Many dedicated OSINT resources surely now exist related to that conflict, and the trends covered here suggest that more will come around inevitable future conflicts as well.</p>
<h2 id="disinformation">Verification & Disinformation Resources</h2>
<p>The “News & News Verification” category saw the next-largest jump in tools & resources between 2021 and 2023. This trend is also not likely a surprise, especially to OSINT practitioners, but the scale of the increase seems notable - the number of verification/disinformation-related resources rose from 28 originally to <i>118</i> last year.</p>
<p>MetaOSINT highlights resources cited most often across a considerable number of input lists. Interestingly, the most-cited verification & disinformation resources (the larger bubbles in the image below) remained largely unchanged across the period - "old reliables" like snopes[.]com & factcheck[.]org. However, a large number of less-frequently-cited resources now also appear. Many of these are likely valuable, but there appears to be less “consensus” in citing many of these other resources. A good reminder that practitioners should always be diligent in validating the origins & mechanics of a particular resource...even if it is ostensibly a verification tool itself!</p>
<a href="https://metaosint.github.io/table" target="_blank"><img style="margin:10px 25px 10px 0px;width:100%;border: 1px solid #f3f3f3;display:block;margin-left:auto;margin-right:auto" src="assets/images/disinformation_resources.png"/></a>
<h2 id="accountability">Accountability</h2>
<p>As many of the resources tracked in this project demonstrate, OSINT often represents an incredibly powerful information source. When used responsibly, OSINT tools & research techniques can drive significant public good - projects like <a href="https://www.tracelabs.org/" target="_blank">Trace Labs</a> (missing persons investigations), <a href="https://thesentry.org/about/" target="_blank">The Sentry</a> (atrocities & corruption in Africa), and <a href="https://citizenevidence.org/" target="_blank">Citizen Evidence Lab</a> (global human rights), represent just a few select examples.</p>
<p>The past few years of OSINT tool tracking yielded an incredible increase in sources related to government & politics, many of which focus on institutional accountability - especially accountability for police and other law enforcement & government officials. In 2021, there were just 14 resources in the “Government & Politics” MetaOSINT sub-category, which mainly focused on national statistics or other factual details. The 2023 update added over 200 more, including numerous projects documenting public evidence of violence, misconduct, and/or complaints involving law enforcement personnel.</p>
<p>Documentation on its own - without corresponding policy, procedural, & behavior modifications - won’t drive material change. But as official sources <a href="https://mappingpoliceviolence.org/about" target="_blank">fail to capture</a> the full scope of imperative issues like police violence and <a href="https://podcasts.apple.com/us/podcast/the-daily/id1200361736?i=1000638925686" target="_blank">gun violence</a> (the Mapping Police Violence project was a resource newly added to MetaOSINT in December 2023), the power of OSINT is primed to help fill critical information gaps as one step on the path towards long-overdue progress.</p>
<h2 id="other">Other Trends</h2>
<p>And here are a few final observations on the evolution of the MetaOSINT dataset:</p>
<ul>
<li>A new “Malware Analysis” sub-category was added in 2023 to account for the considerable number of resources shared around that theme (33 in the dataset as of December 2023).</li>
<li>A large number of resources have always existed in the “Workflow / Productivity Tools” category, but a considerable number of new ones (almost 500) were also added in the latest update. Many of the new tools appear to focus on helping practitioners build investigation timelines and other types of data visualizations.</li>
<li>Certain phone number and related lookup services that topped the citations list in 2021 (like freecarrierlookup[.]com, 411[.]com, and phonevalidator[.]com) were far less represented in the set of resources added in 2023 - perhaps a reflection of communication trends in general? Sync[.]me, a service that emphasizes blocking of spam calls, topped the list of recently added resources in terms of citation count (12, versus five in 2021).</li>
<li>The number of “Radio & Podcasts” OSINT resources increased by a margin that surprised me. New resources include lists of radio & podcast channels, solutions for web-based radio listening, and transcription tools. The original collections may simply have been lacking in these types of resources, but perhaps quarantine habits influenced listening (and even production) trends to an extent that was also reflected in the recently added OSINT resources 🎙</li>
</ul>
<p>I’m certain there are many more insights to be gleaned from analyzing the MetaOSINT collection (remember, all the underlying data is <a href="https://github.com/MetaOSINT/MetaOSINT.github.io/blob/main/table.csv" target="_blank">available on GitHub</a>)...so dig in, and be sure to let me know what you find!</p>
</div>
<div style="text-align:center;padding:20px 0px 15px 0px;font-size:20px">
<a href="https://metaosint.github.io/learn-more" target="_blank">Learn more about MetaOSINT</a>
<a class="nav-link" href="https://tropchaud.github.io/" target="_blank" style="text-decoration:none;padding:10px;font-size:20px">
<svg xmlns="http://www.w3.org/2000/svg" class="social-icon" height="20" width="20" viewBox="0 0 576 512"><!--!Font Awesome Free 6.5.1 by @fontawesome - https://fontawesome.com License - https://fontawesome.com/license/free Copyright 2024 Fonticons, Inc.--><path d="M384 480h48c11.4 0 21.9-6 27.6-15.9l112-192c5.8-9.9 5.8-22.1 .1-32.1S555.5 224 544 224H144c-11.4 0-21.9 6-27.6 15.9L48 357.1V96c0-8.8 7.2-16 16-16H181.5c4.2 0 8.3 1.7 11.3 4.7l26.5 26.5c21 21 49.5 32.8 79.2 32.8H416c8.8 0 16 7.2 16 16v32h48V160c0-35.3-28.7-64-64-64H298.5c-17 0-33.3-6.7-45.3-18.7L226.7 50.7c-12-12-28.3-18.7-45.3-18.7H64C28.7 32 0 60.7 0 96V416c0 35.3 28.7 64 64 64H87.7 384z"/></svg>
Explore TropChaud's other projects
</a>
</div>
</body>
</html>