Zeitschrift für Germanistik und Gegenwart
Joachim Harst und
Nursan Celik
Virtual Investigations
Revising the Evidential Paradigm in Law, Literature and the ArtsLizenz:
For this
publication, a Creative Commons Attribution 4.0 International license
has been granted by the author(s), who retain full
copyright.
Link
Wiener Digitale Revue 5 (2024)
www.univie.ac.at/wdrAbstract
Top of pageKeywords
Top of pageOutline
Top of pageFull text
Top of pageOn May 4 and 5, 2023, an interdisciplinary conference on the topic of Virtual Investigations. Revising the Evidential Paradigm in Law, Literature, and the Arts took place at the Collaborative Research Center 1385 Law and Literature (Münster, Germany). In the following, the conference’s organizers report on the issues discussed at the conference and outline the project of an associated book publication (this project has been meanwhile realized in a slightly different form, Harst/Celik/Jengdes 2024).
1. Questions
When Ginzburg (1995) formulated the thesis that the humanities, like crime fiction, were based on the so-called evidential paradigm, he had Sherlock Holmes in mind, a detective who would visit crime scenes himself. He would then collect clues there, combine them and come to the solution of his case through often ingenious, but also highly speculative conclusions. However, as clues can only be identified as such within the framework of an overall narrative (“course of events”), Ginzburg emphasized the narrative aspect of interpreting clues and argued that the humanities search for and interpret clues in a similar fashion. Their acquisition of knowledge strongly resembles the detective’s. In addition, the evidential paradigm has been used in various ways to analyze literary and pictorial works of art: on the one hand, works of art can be examined for traces of past reality or, conversely, the evidential paradigm may be utilized as an artistic device to construct reality or guide our reception.
Against the backdrop of current developments in research and investigation, however, the evidential paradigm requires revision. Ever since the private detective is facing competition from “Kommissar Computer” (Hartung 2010), investigative practices have changed fundamentally. Computer-aided search and investigation methods can now supplement or even replace a crime scene inspection. In the popular narrative of modern investigation, the individual investigator is thus replaced by a team of forensic experts who solve cases using digital data processing. We can therefore observe a “fundamental change in the patterns of interpretation of the world of crime”: While Columbo’s investigations, for instance, mostly started on a social and psychological level, murderers and victims are now “only of interest as carriers of traces that can generate evidence” (Gugerli 2007: 12, our translation). With reference to the successful series CSI: Crime Scene Investigation (USA 2000–2015), the question of what repercussions this has on criminal and legal practice is discussed under the heading of the “CSI effect” (ibid.). One of the key problems caused by it is the question as to what extent a judge can understand how algorithmic trace analysis works. Additionally, there is a potential risk that a judge’s assessment of evidence will primarily be based on a belief in the proper functioning of algorithms.
While such investigative practices are associated with positivist claims regarding knowledge in popular narratives, their constructivist dimension needs to be examined from an academic perspective: Reconstructions, visualizations, and simulations produce evidence. Visualizations often achieve an evidentiality that goes beyond the data they are based on. They are preceded by the digital amplification and aggregation of data into traces. Similar to the scientific experimental system (Rheinberger 2007), digital traces can be considered technically produced mediators that indicate the invisible.
Today’s open source investigations, such as those conducted by Forensic Architecture and Bellingcat, lend themselves to such reflections. Firstly, the investigations of these “digital sherlocks” are based on the digitization of crime scenes and computer-aided data processing, often drawing on freely accessible documentary material. Their task lies in making the often randomly generated material legible so that traces emerge from it. Secondly, and in addition to research reports, Forensic Architecture produces artfully composed documentaries that aesthetically and rhetorically underpin their material-based and activist standpoint. Thirdly, Forensic Architecture and comparable investigative artists (e.g. the photographers Trevor Paglen and Edmund Clark) provide their media artifacts with a meta-reflexive discourse that reflects virtual investigations and their claim to knowledge – also with reference to Ginzburg and the evidential paradigm (cf. Weizman/Fuller 2021: ch. 10).
2. Virtuality
The subject of virtual investigations does not only refer to contemporary open source intelligence, but also addresses the epistemological configurations of virtuality and traces in recent cultural history. For that reason, increasing attention has been paid to literary crime and detective fiction, which in turn has provided decisive impulses for reflecting virtuality. In his reading of Poe’s Purloined Letter, Lacan (1966) described the purloined letter as a virtual object, which differs from the real object in that it can be missing from its place: While the police investigate the suspect’s property in search of the stolen letter as meticulously as unsuccessfully, the private detective Dupin recognizes the letter precisely where one would never expect to find it, namely on the letter holder – it has simply been made unrecognizable by being turned over. Deleuze also refers to this reading when he negotiates difference and repetition in the sign of virtuality (Deleuze 1968: 135f.). Like Lacan, Deleuze links the virtual with the symbolic in order to ultimately connect it with structure and difference: Language, for example, is virtual as a differential structure (langue) that is actualized in individual speech acts (parole). Accordingly, reality and virtuality must not be understood as opposites (structures are very much real), just like, conversely, virtuality and possibility/potentiality are not synonyms (the actualization of a structure is not a reduction of a spectrum of possibilities).
The significance of this distinction becomes even clearer once we look at another domain of the virtual: the use of statistics and probability to observe, manage, and govern modern societies, which began in the 18th and 19th centuries (cf. Schäffner 1999, Nassehi 2019). It allows a calculation with the unknown, such as one of the current population on the basis of birth registers and death probability (cf. Schäffner 1999: 124). The accompanying shift from truth to probability leads to a virtualization of knowledge, resulting in the distinction between real and non-real being transformed into a continuity of more or less probable events. In this regard, too, virtuality is not opposed to reality but encompasses the continuum of both occurring and (simply) probable events (cf. Vogl 1998). The use of statistical surveys for government purposes and their elimination of unknown individual factors is also reflected in contemporary detective stories. Holmes for instance summarizes a treatise by Winwood Reade (The Martyrdom of Man, 1872) according to which man, as an individual an unsolvable riddle, becomes a “mathematical certainty” in the aggregate (Doyle 2005: vol. 3, 330; cf. Boltanski 2012: 137, note 76; Campe 2012). Later investigative narratives such as Stanislaw Lem’s Katar (The Chain of Chance, 1976) also draw on statistical correlations, but tend to elaborate the absurdity of detective trace-reading in the face of the “law of large numbers”: here, the solution to the case is reflected as the statistically necessary product of an infinite series of attempts. J. L. Borges also implies a multiplicity of virtual worlds in stories with an investigative plot: El jardín de senderos que se bifurcan (The Garden of Forking Paths, 1941) designs a book in which fictional worlds multiply with each turning point of its plot, while in La muerte y la brújula (Death and the Compass, 1942), the initial death turns out to be a coincidence that the criminal uses as an opportunity to set a virtual trap for his antagonist: upon arriving at the scene of the anticipated fourth murder, which the detective had calculated based on a series of crimes, he only discovers his own killer.
The omnipresent play with symmetries, doublings, and reflections in the fictional examples mentioned above also forms a link to a third aspect of virtuality, which relates to the optical register. Mirror images open up a virtual space by pretending that mirrored objects are located behind the mirror surface (Krämer 1998: 32). In a similar sense, today’s computer screens can be understood as “interactive mirrors” (ibid.). Because large amounts of data cannot be processed on a purely linguistic level, data-based investigations require virtual interfaces. These can include complex query tools as well as applications for visualizing, modeling, and navigating data. Like the mirror, computers and screens can open up a new perspective on what is mirrored, which in this case lies “in the interactive, possibly also synesthetic handling of data structures” (Krämer 1998: 32f., our translation). If every investigator has to construct a “mental model” in order to examine possible connections between clues (Rothöhler 2021: 17), then computer-aided models and simulations can visualize this “virtual intermediate product of criminal reverse engineering” (ibid., our translation) and make it navigable. This is what Weizman and Fuller mean when they say that digital or digitized “shards of evidence” only become fully valid evidence in the virtual model (Weizman/Fuller 2021: 5f.). On the other hand, it must be recognized that virtual models and simulations have both a representative and an interpretative function: “Visual models suggest interpretations, they emphasize and conceal differences and exclude other interpretations” (Reichle/Siegel/Spelten 2008: 12).
3. Data, traces, patterns
The consideration of investigations in the light of virtuality also leads to the need for a reconfiguration of the concept of the trace. As Ginzburg pointed out, in the 19th century the fingerprint was considered the archetype of the trace, which can be understood as the material remnant of a past presence. As a result, the trace gains an indexical relationship to its cause. In the case of digitized traces, however, indexicality is lost through the conventionality and universality of binary code: binary-coded data can be read as the effect of writing processes, but no longer as an indexical trace (Grube 2007: 238f.). This applies even more to digital data, which – as can be proven by various investigations of Forensic Architecture – only become meaningful traces through complex, virtually mediated design processes. Using the fingerprint as the archetype of the trace, a comparison with digital “fingerprints” is instructive: for example, various aspects of an individual hardware and software configuration can be combined to form a “browser fingerprint”, which enables precise identification of devices and users on the Internet. When discussing “data traces” of internet usage, it is hence important to note that this term refers to a digital artifact created with huge computational effort rather than to an involuntary remnant (Reigeluth 2015).
However, the absence of indexicality in digital traces does not diminish the compelling nature of the information they provide. Rather, it is simply a different type of evidence. Whereas the indexical relation, in addition to the certainty of a cause, opens up a qualitative need for interpretation with regard to an individual case, “data trails” are often processed into statistical profiles that point to possibilities and futures. The “mathematical certainty” – to use Holmes’ term – with which such virtual traces provide information about future or past behavior remains trapped in the continuum of probabilities and cannot be related back to the individual and empirical level beyond doubt.
The claim to knowledge that is free of hypotheses and interpretation is of course no longer put forward with the verve of 15 years ago. But even if nobody wants to “let the data speak for itself” anymore, algorithms are supposed to recognize potentially relevant patterns, abstract hypotheses from them and in turn statistically verify them based on the material (Kitchin 2014). A similar process takes place at the level of internet search engines and generative language models, which use the internet as a “database”. Search engines index the internet and suggest websites depending on search queries and user profiles. “From this point of view, the data on the Internet is ‘virtual information’ that only becomes real if you search for it, produce it and allow yourself to be surprised by it” (Esposito 1998: 292, our translation). This is all the more true for so-called artificial intelligence, which no longer outputs the data it finds, but formulates its own answers – virtual knowledge per se – on the basis of the language model calculated from them.
However, virtual investigations do not cement the categorical difference between evidential and data-based knowledge. Instead, they focus on research objects that interweave the latter with the former: Whether it is the combination of literary searches for clues with “large number” problems, or the combination of data-driven research with detective narrative forms. In this way, virtual investigations reveal a fundamental transformation of the evidential paradigm in the age of digitalization. By linking the investigation back to concepts that the methodological self-reflection of the humanities has engaged with since the 1970s, it is possible to highlight both the epistemic ruptures which make virtual investigations possible and the methodological and narrative continuities with conventional investigative work.
4. Structure of the publication
Based on this concept, an interdisciplinary conference was held on May 4 and 5, 2023 as part of the CRC 1385 Law and Literature at University of Münster, Germany, the contributions of which are currently being revised for an anthology. In keeping with the thematic framework of the CRC, the conference focused not only on literary and artistic investigations, but also on the legal dimension of the evidential paradigm. Participants examined the semiotic status of circumstantial evidence in historical and contemporary legal practice and explored the virtualization of police work in the context of dragnet investigations and predictive policing. A focal point of the conference was an evening lecture by the director of the Frankfurter Kunstverein, Professor Franziska Nori, which took place at the Picasso Museum in Münster and included a panorama of contemporary investigative art both from the national and international art landscape. Drawing on her curatorial collaboration with Forensic Architecture, she discussed the relationship between investigative art and its socially relevant potential for exposure.
The following three thematic sections are planned for the anthology:
(1)
Under the title Evidential Paradigm and Investigative Literature, the relationship between trace and virtuality in legal, literary and cultural contexts is examined. Thus we will draw a line from the beginnings of the evidential paradigm in the 18th century up to the present. Antonia Eder (Karlsruhe), whose current projects include research regarding the status of evidentiality in literature, semiotics and law, opens the section. In her contribution, she sheds light on the concept and emergence of circumstantial evidence in the 18th century and reconstructs contemporary reflection on the knowledge to be gained through circumstantial evidence – both with regard to jurisprudence and literary texts. Sebastian Speth (Münster) focuses on the role of trace-reading for the early modern institution of “Gute Policey” and the extent to which this should be understood as a preliminary form of “predictive policing”: the police systems of 18th and 19th century did not see their responsibility primarily in solving crimes that had been committed, but rather in preventing potential future crimes. Accordingly, one of their main tasks lay in detecting those traces that made virtual futures legible – and, for example, identifying the characteristic traits that made an individual recognizable as a potential criminal. Speth’s investigation therefore aims to expand detective or police trace reading, which according to Ginzburg is limited to “retrospective divination” (Ginzburg 1995: 30, our translation), to include the dimension of the future.
From the perspective of literary studies, Reinhard Möller (Frankfurt a. M.) takes up the topic by examining Dürrenmatt’s Das Versprechen (The Promise, 1958) and Lem’s Katar (The Chain of Chance, 1976), two crime novels that replace traditional trace-reading with pattern recognition and seriality – and thereby correlate chance and probability in different ways: both investigative characters seek to solve a crime by reconstructing its conditions as faithfully as possible in order to entice the perpetrator to repeat his crime. But while the Swiss detective is deprived of his “prey” by chance, Lem’s investigator reaches his goal by accident, which, however, is declared to be a statistical necessity in a potentially infinite series of experiments. Both novels thus also deal with the relationship between chance and the literary form of investigation. Additionally, they raise the question what information an always narratively reshaped reading of traces can actually provide on a reality characterized by contingency.
This section concludes with a contribution by Tobias Lebens (Tübingen), who is currently working on a dissertation on literary forensics. In his essay, he focuses on the concept of forensic aesthetics in relation to contemporary literary investigations. Analogous to the former term, which emphasizes the importance of aesthetics for the collection, analysis and presentation of forensic material (cf. Keenan/Weizman 2012), Lebens asks to what extent literary writing not only emulates investigative practices, but can itself be investigative. Crucial for his analysis are German-language texts on the post-Yugoslav wars, in particular Anna Kim’s Die gefrorene Zeit (2008).
(2)
The second section of the anthology focuses on approaches to the virtualization of investigative practices associated with the term Rasterfahndung (“dragnet investigation”) in film, legal and police studies. Amadou Sow (Hamburg), for example, reconstructs the legal background to negative dragnet investigations, which were developed by Horst Herold in the German Autumn (Hartung 2010; Bergien 2017). Instead of searching for known individuals based on specific personal identifiers, negative dragnet investigations profile groups of people based on combined exclusion criteria and use these to screen various non-police databases. This enables querying databases for potential offenders who are not yet known to the police, which then enables the police to reckon with the unknown (Hartung 2010) and systematically switch from reconnaissance to prevention. While Sow is interested in the extent to which the dragnet search introduces a new legal paradigm, Anna Mayer (New York) examines media reflections on the search method while discussing Volker Schlöndorff’s and Margharete von Trotta’s film Die verlorene Ehre der Katharina Blum (The Lost Honour of Katharina Blum, 1975). In doing so, she emphasizes the staging of digital data processing, but also visual and architectural grids, which the film uses to reflect the emerging digital surveillance. Felix Bode, Harald Kania and Stefan Kersting make a connection to current police investigation methods by presenting various strategies of predictive policing, such as the SKALA project of the North Rhine-Westphalia state bureau of investigation: This project explores the possibilities of reducing the number of residential burglaries by statistically calculating risk areas and distributing police presence accordingly. They also discuss the extent to which the virtualization of police work responds to the digitalization of crime and the significance of the term “objective search for evidence” in the context of digital forensics.
(3)
The third and final section of the anthology, Forensic Media Practices, focuses on aspects of virtual investigations in media and film studies. Joachim Harst opens the section with his examination of various case studies of contemporary virtual investigations with the research groups Bellingcat and Forensic Architecture as well as the investigative photographers Trevor Paglen and Edmund Clark in order to highlight the role of the trace for research and the presentation of results. Analogous to the considerations outlined in the introduction, the primary question is to what extent and in what way the virtuality of digitally produced traces is reflected in the respective media artifacts (blog posts, web videos, and digital photographs). The question of documentation and testimony is picked up by Carolin Höfler (Cologne) in her contribution, which puts a special focus on the concepts of material and networked testimony. Höfler uses case studies from politics, art, and architecture to reflect on the documentary potential of digital images, models and simulations and questions the modes of digital evidentialization. Höfler’s discussion of an investigation of Forensic Architecture is continued in the contribution by media scholar Vesna Schierbaum (Bochum), who analyzes the “aesthetics of objectivity” in the investigation The Beirut Port Explosion (2020) by the aforementioned research group. By drawing on this example, she offers a critical discussion of traces in the virtual model and their narrative evidentialization in the animated video.
Finally, two further contributions deal with investigative forms in computer games and digital films. Based on the materiality and physicality of the archetypal fingerprint, Ulrich Meurer (Vienna) deals with the availability and possibilities of reshaping the body in virtual space. He presents his reflections on the basis of contemporary video art, including Hito Steyerl’s How Not to Be Seen: A Fucking Didactic Educational .MOV File (2013) and Liam Young’s Choreographic Camouflage (2021). Both artworks reflect on the growing capabilities of algorithmic face and body recognition and design strategies to evade them. The volume concludes with a contribution by Johannes Ueberfeldt (Münster), whose research focuses on crime literature in its various media forms. Ueberfeldt explains how digital crime fiction games initiate a multimodal and poly-semiotic search for traces of reception, resulting in recipients or players themselves becoming the object of the interactive game within the framework of a ludic-technical dispositive.
Bibliography
Top of page- Bergien, Rüdiger (2017): “Big Data” als Vision. Computereinführung und Organisationswandel in BKA und Staatssicherheit (1967–1989), in: Zeithistorische Forschungen 14/2, pp. 258–285.
- Boltanski, Luc (2012): Énigmes et complots: une enquête à propos d’enquêtes. Paris: Gallimard.
- Campe, Rüdiger (2012): Ereignis der Wirklichkeit. Über Erzählung und Probabilität bei Balzac (Ferragus) und Poe (Marie Rogêt), in: Michael Gamper and Michael Bies (eds.): Literatur und Nicht-Wissen. Historische Konstellationen in Literatur und Wissenschaft, 1730–1930. Zürich: Diaphanes, pp. 263–288.
- Conan Doyle, Arthur (2005): The New Annotated Sherlock Holmes. Ed. by Leslie Klinger, 3 Vols. New York, NY: Norton.
- Deleuze, Gilles (1968): Différence et répétition. Paris: PUF.
- Esposito, Elena (1998): Fiktion und Virtualität, in: Sybille Krämer (ed.): Medien, Computer, Realität. Wirklichkeitsvorstellungen und Neue Medien. Frankfurt a. M.: Suhrkamp, pp. 269–296.
- Ginzburg, Carlo (1995): Spurensicherung. Der Jäger entziffert die Fährte, Sherlock Holmes nimmt die Lupe, Freud liest Morelli. Die Wissenschaft auf der Suche nach sich Selbst, in: Spurensicherung. Die Wissenschaft auf der Suche nach sich selbst. Berlin: Wagenbach, pp. 7–44.
- Grube, Gernot (2007): ‘abfährten’ – ‘arbeiten’. Investigative Erkenntnistheorie, in: Sybille Krämer und Werner Kogge (eds.): Spur: Spurenlesen als Orientierungstechnik und Wissenskunst. Frankfurt a. M.: Suhrkamp, pp. 222–256.
- Gugerli, David (2007): Die Welt als Datenbank. Zur Relation von Softwareentwicklung, Abfragetechnik und Deutungsautonomie, in: Nach Feierabend 5/3, pp. 11–36.
- Harst, Joachim/Celik, Nursan/Jendges, Rahel (eds.) (2024): Virtuelle lnvestigationen. Revisionen des lndizienparadigmas in Literatur und Kunst. USB Monographs. DOI: 10.18716/omp.35.
- Hartung, Lea (2010): Kommissar Computer: Horst Herold und die Virtualisierung des polizeilichen Wissens. Phd thesis, FU Berlin. refubium.fu-berlin.de/bitstream/handle/fub188/18667/StaR-P_w_7_Herold.pdf?sequence=1, DOI: 10.17169/REFUBIUM-22356 (accessed January 15, 2024).
- Keenan, Thomas/Weizmann, Eyal (2012): Mengele’s Skull: The Advent of a Forensic Aesthetics. Berlin: Sternberg; Portikus.
- Kitchin, Rob (2014): Big Data, New Epistemologies and Paradigm Shifts, in: Big Data & Society 1/1, pp. 1–12.
- Krämer, Sybille (1998): Zentralperspektive, Kalkül, Virtuelle Realität. Sieben Thesen über die Weltbildimplikationen symbolischer Formen, in: Gianni Vattimo (ed.): Medien-Welten, Wirklichkeiten. München: Fink, pp. 27–38.
- Lacan, Jacques (1966): Le séminaire sur la lettre volée, in: Écrits. Paris: Seuil, pp. 11–41.
- Nassehi, Armin (2019): Muster: Theorie der digitalen Gesellschaft. München: Beck.
- Reichle, Ingeborg/Siegel, Steffen/Spelten, Achim (eds.) (2008): Visuelle Modelle. Paderborn: Fink.
- Reigeluth, Tyler (2015): Les affections du corps en milieu numérique: Matérialité et discursivité des traces, in: Béatrice Galinon-Melene (ed.): L’Homme-trace. Inscriptions corporelles et techniques. Paris: CNRS éditions, pp. 63–76.
- Rheinberger, Hans-Jörg (2007): Spurenlesen im Experimentalsystem, in: Sybille Krämer und Werner Kogge (eds.): Spur: Spurenlesen als Orientierungstechnik und Wissenskunst. Frankfurt a. M.: Suhrkamp, pp. 293–308.
- Rothöhler, Simon (2021): Medien der Forensik. Bielefeld: transcript.
- Schäffner, Wolfgang (1999): Nicht-Wissen um 1800, in: Joseph Vogl (ed.): Poetologien des Wissens um 1800. München: Fink, pp. 123–144.
- Vogl, Joseph (1998): Grinsen ohne Katze. Vom Wissen virtueller Objekte, in: Hans-Christian von Herrmann and Matthias Midell (eds.): Orte der Kulturwissenschaft. Fünf Vorträge. Leipzig: Leipziger Universitätsverlag, pp. 41–53.
- Weizman, Eyal/Fuller, Matthew (2021): Investigative Aesthetics: Conflicts and Commons in the Politics of Truth. London: Verso.