OSINT and information gathering

OSINT and information gathering

The first step in preparing an attack is information gathering. This information can be collected from many sources. In this article we look at scenarios in which it is obtained from open sources, or disclosed by company servers that were not configured carefully enough.

OSINT

OSINT (Open Source Intelligence) is a method of collecting and analysing information that is publicly available in open sources, such as websites, social networks, forums, blogs, news articles and other public sources. OSINT uses research and analysis techniques to obtain relevant and useful information.

The method focuses on information that is already in the public domain, removing the need to access restricted or confidential sources. OSINT is therefore used in many fields and contexts, such as academic research, legal investigations, security threat analysis, online monitoring and more.

There is a wide range of techniques and tools for OSINT, including advanced web search, social media analysis, monitoring of public data and the use of open databases. They can be applied ethically and legally, in line with data protection and privacy laws.

Metadata of documents and images published on the website

Public documents that contain metadata can reveal sensitive information without anyone intending to. Metadata is information embedded in files such as documents, images, spreadsheets or presentations, and may include author names, creation dates, GPS coordinates, software versions and revision history.

This information may seem harmless, but it can reveal details about the author's identity, the software installed on their machine, their location or organisational affiliation, which attackers can exploit. For example, if a government agency accidentally publishes a document whose metadata identifies the author as a confidential informant, that person may be put in danger.

Names or user names extracted from document metadata can also be used in targeted social engineering campaigns or to build recipient lists for phishing. Software names and versions can help exploit the system of the user who created the document if those versions have known critical vulnerabilities.

Remediation:

To prevent these risks, remove metadata from documents before sharing them publicly. This can be done with the tools built into document editors or with dedicated metadata removal software. Organisations should also set policies and procedures for handling sensitive information and train their employees in good practice for handling and sharing documents.

Important

Use robots.txt as a complementary measure to avoid the indexing of directories or pages that may contain sensitive information. To see how robots.txt can be used, read the article about Google Dorks.

HTML comments and web page metadata

HTML comments and web page metadata, like document metadata, can accidentally reveal sensitive information that is useful in attacks. HTML comments are pieces of text added to a page's HTML source that are hidden from users and visible only in the page source. They may contain notes for developers or designers, or in some cases even passwords.

Similarly, web page metadata may include the author's name, creation or last modified date and keywords related to the page content. This can give attackers valuable information. For example, if an author's name is included in the metadata of a page discussing sensitive or controversial topics, that person can become a target.

Remediation:

Remove comments and metadata containing sensitive information before publishing pages. Website administrators should regularly audit their sites to identify and remove any unnecessary metadata or comments that could be a security risk.

Important

Use robots.txt as a complementary measure to avoid the indexing of directories or pages that may contain sensitive information. See the article about Google Dorks.

Server and web service fingerprinting

Fingerprinting is the process of determining the type and version of the software used by the publicly exposed services of a server. Attackers can use this information to identify known vulnerabilities and exploit them to compromise the web server and gain unauthorised access to sensitive data.

We wrote about fingerprinting in more detail in: Fingerprinting: identifying the web server and its services

  • osint
  • information gathering
  • open source intelligence
  • cybersecurity
Iulian Băncău

Security Engineer · All Safe

More than CyberSecurity

We offer a variety of services to help companies be prepared for real cyber attacks.