Dr. Benedikt Lorch

Former PhD candidate in the multimedia security group and member of the research training group Cybercrime and Forensic Computing, now with University of Innsbruck. My research interests include image forensics, computer vision, and machine learning.

Recent projects

Compliance challenges in forensic image analysis under the artificial intelligence act (EUSIPCO 2022)

In many applications of forensic image analysis, state-of-the-art results are nowadays achieved with AI methods. However, concerns about their reliability and opaqueness raise the question whether such methods can be used in criminal investigations from a legal perspective. In April 2021, the European Commission proposed the artificial intelligence act, a regulatory framework for the trustworthy use of AI. Under the draft AI act, high-risk AI systems for use in law enforcement are permitted but subject to compliance with mandatory requirements. In this paper, we summarize the mandatory requirements for high-risk AI systems and discuss these requirements in light of two forensic applications, license plate recognition and deep fake detection. The goal of this work is to raise awareness of the upcoming legal requirements and to point out avenues for future research.

Paper | arXiv

Reliable camera model identification using sparse Gaussian processes (IEEE SPL 2021)

Identifying the model of a camera that has captured an image can be an important task in criminal investigations. Many methods assume that the image under analysis originates from a given set of known camera models. In practice, however, a photo can come from an unknown camera model, or its appearance could have been altered by unknown post-processing. In such a case, forensic detectors are prone to fail silently.
One way to mitigate silent failures is to use a rejection mechanism for unknown examples. In this work, we propose Gaussian processes (GPs), which intrinsically provide such a rejection mechanism. This makes GPs a potentially powerful tool in multimedia forensics, where forensic analysts regularly work on images from unknown origins.

Paper | Slides | GitHub

Reliable JPEG forensics via model uncertainty (IEEE WIFS 2020)

Many methods in image forensics are sensitive to varying amounts of JPEG compression. To mitigate this issue, it is either possible to a) build detectors that better generalize to unknown JPEG settings, or to b) train multiple detectors, where each is specialized to a narrow range of JPEG qualities. While the first approach is currently an open challenge, the second approach may silently fail, even for only slight mismatches in training and testing distributions. To alleviate this challenge, we propose a forensic detector that is able to express uncertainty in its predictions. This allows detecting test samples for which the training distribution is not representative. The applicability of the proposed method is evaluated on the task of detecting JPEG double compression.
Paper | Slides | GitHub

Image forensics from chroma wrinkles (ACM IH&MMSec 2019)

This work presents a novel artifact that can be used to fingerprint the JPEG compression library. The artifact arises from chroma subsampling in one of the most popular JPEG implementations. Due to integer rounding, every second column of the compressed chroma channel appears on average slightly brighter than its neighboring columns, which is why we call the artifact a chroma wrinkle. We theoretically derive the chroma wrinkle footprint in DCT domain, and use this footprint for detecting chroma wrinkles.
Paper | Slides | GitHub

Forensic reconstruction of severely degraded license plates (IS&T Electronic Imaging 2019)

Forensic investigations often have to contend with extremely low-quality images that can provide critical evidence. Recent work has shown that, although not visually apparent, information can be recovered from such low-resolution and degraded images. We developed a CNN-based approach to decipher the contents of low-quality images of license plates.
Paper | Slides | GitHub

Quick links

• Forensics conference deadlines

PGP

Key ID	D7994F61EECD8C75
SHA-1 Fingerprint	1781 F23E FB55 50E6 BA75 ED4E D799 4F61 EECD 8C75
Public Key	ASCII-armored

S/MIME

Serial Number	11538170719656647013182884190 (25:48:26:B0:09:BB:96:F6:05:B2:49:5E)
SHA-1 Fingerprint	7F:EA:AC:5F:EB:4D:D4:C5:EF:D2:29:83:62:F1:82:49:01:48:7E:35
SHA-256 Fingerprint	2F:7C:B3:3A:4B:14:CC:46:8F:A1:15:B7:C4:EC:08:60:46:35:14:2E:28:B4:01:B2:FF:98:0C:14:24:9F:5E:BA
Issuer	DFN-Verein Global Issuing CA < DFN-Verein Certification Authority 2 < T-TeleSec GlobalRoot Class 2
Certificate	PEM / DER / TXT

Retrieve from DFN.

Publications