## LLM Usage at a German Law Firm

-------------

### Who is using it?
The legal tech department of a German law firm with over 350 employees is exploring the usage of AI-based solutions to support the daily legal work of the lawyers. The department consists of 6 employees and is responsible for the digital transformation and legal tech strategy.

### What problem(s) are they solving?
The most important problem to solve is how to schematically process large collections of documents. Therefore, extraction of relevant information from documents is the main use case the department is using AI-based solutions for. Other related use cases are the classification of documents and being able to ask the AI questions about the contents of a document.

### Which NLP technologies are they using?
The law firm has been using tools based on machine learning for multiple years and is currently looking at solutions like Legisway Analyzer ([https://www.wolterskluwer.com/en-gb/solutions/legisway/legisway-analyzer](https://www.wolterskluwer.com/en-gb/solutions/legisway/legisway-analyzer)) and Harvey ([https://www.harvey.ai/](https://www.harvey.ai/)). The output is perceived to be really good but still requires manual checking to make sure the information is not hallucinated.

### Stage
Production - users are using the tool in their daily workflow

### Challenges
- Most processes can not be fully automated yet and still require a human in the loop
- OCR does not always work as intended, especially for old documents that only exist on paper and need to be scanned
- Form-based data is more difficult to process with NLP than unstructured textual data (full sentences)
- Ensuring GDPR compliance

### Source
Two interviews conducted in May 2024, led by sebis researchers, one interviewee is a lawyer and the head of the legal tech department at the company, the other is an associate of the same law firm and part of the legal tech team.

LLM Usage at a German Law Firm

## AI Solution Provider: Mioto Labs

-------------

### Who is using it?
The solution is targeted at small- to medium-sized law firms.

### What problem(s) are they solving?
Mioto Labs ([https://mioto.app/](https://mioto.app/)) offers custom-tailored solutions for customers in the legal domain. Typical use cases include but are not limited to contract generation based on pre-defined templates, document review and analysis, and information extraction.

### Which NLP technologies are they using?
The solution currently consists of a workflow builder for process automation. Commercial LLMs like ChatGPT through an Azure instance are used to assist in specific steps of the workflow, e.g., to extract information from documents. Depending on the needs of the customers, the team decided where and when in the workflow chain it makes sense to utilize LLMs to achieve a specific subtask.

### Challenges
- SaaS is difficult to market to customers in the legal domain
- Building custom solutions for customers requires a lot of flexibility from the development team as requirements are not often clear at the beginning

### Source
Interview conducted in May 2024, led by sebis researchers. The interviewee is a co-founder and the CTO of the company.

AI Solution Provider: Mioto Labs

## LLM Usage at a German Law Firm

-------------

### Who is using it?
The corporate Merger & Acquistions department of a law firm totaling over 100 employees and specializing on German law is testing the usage of AI and LLMs to speed up their work.

### What problem(s) are they solving?
The employees use an LLM-based tool in hopes of improving their efficiency to draft contracts. Normally, new contracts are constructed by reusing and adapting clauses from past contracts. The tool helps automate this task by importing clauses from other documents and adapting them to the new context. The tool is used for assistance as it still requires a good amount of manual effort.
One reason for incorporating AI technology into their weekly routine is the perception that customers now expect it in this day and age.

### Which NLP technologies are they using?
A few selected lawyers of the department are testing Henchman ([https://henchman.io/](https://henchman.io/)), a multi-LLM contract drafting and negotiating AI solution, to assess a potential department-wide adoption of the tool. One of the employed LLMs is ChatGPT running on an Azure instance so that the data is not used to train the model and remains within the EU. Users can interact with the system through an Add-In in Word or Outlook.

### Stage
Research - different users are experimenting with the usage of LLMs

### Challenges
- Lawyers need to invest time and effort to incorporate the tool into their routine before any efficiency gains can be realized
- The tool is only as good as the existing documents from the past. Changes in legal regulations are naturally not reflected yet for future contracts.

### Source
Two interviews conducted in April and May 2024, led by sebis researchers. One interviewee is a lawyer working in corporate Mergers and Acquisitions at a German law firm and the other is a legal tech consultant.

## LLM Usage at a German Law Firm

-------------

### Who is using it?
A large German law firm is developing their own solution to assist in their legal work but the solution is also provided to interested legal professionals who need to generate documents in their daily work, e.g., contracts.

### What problem(s) are they solving?
The main use case aims at generating legal documents based on templates and data inputs but the solution is also able to assist in other legal tasks surrounding document management. The company is currently evaluating the usage of AI in various aspects of their work to derive new use cases that can benefit from its usage.

### Which NLP technologies are they using?
The company uses AI pipelines (i.e., Retrieval Augmented Generation) that are independent of a specific LLM and always aim to use the best LLM depending on use case. Currently, they are working with GPT-4 deployed on their own Azure instance but are aiming at also including Claude Opus. The company took all their documents, anonymized them, and embedded them in a vector database to allow for a semantic search. From this existing knowledge base new documents can be generated through pre-defined prompts. The functionality is accessible through a Word Add-In that is connected to the pipeline built on the deepset cloud. Subtasks of the pipeline also employ other NLP methods such as Named Entity Recognition (NER).


### Stage
Research - the solution is under active development and different users are evaluating its usage

### Challenges
- Developing your own AI is resource-intensive and not practical in an environment with frequent law changes
- Users require proper training in order to utilize the full potential of novel AI-based solutions

### Source
Interview conducted in April 2024, led by sebis researchers. The interviewee is the CEO of a spin-off company.

## AI Usage at a German Law Firm

-------------

### Who is using it?

A large law firm with over 300 lawyers is evaluating the use of legal AI at their firm. The target audience of the tools are legal professionals.

### What problem(s) are they trying to solve?
The firm is interested in understanding the potential benefits of using AI in their practice, such as automating repetitive tasks, improving decision-making speed, and increasing overall efficiency. Therefore, the firm called into action an AI initiative consisting of multiple lawyers to explore and evaluate the use of legal AI.

The use cases under investigation include:
- Document analysis
- Document generation (e.g., contracts)
- Document summarization (e.g., summarizing court decisions)
- Due diligence
- Question Answering

For Question Answering, they are building a curated knowledge base containing all admissible company data that can then be queried through the chat interface. The semantic search also provides references to the sourced documents.

### Which NLP technologies are they using?
The law firm is evaluating the use of different LLMs including proprietary models like ChatGPT (OpenAI) and Luminous (Aleph Alpha), as well as open-source models like Llama.
For their daily work, all employees have access to ChatGPT deployed on their own Azure instance to ensure data is not used for training. To manage and reduce the costs associated with LLM usage, token length is limited.
Some users are also testing Copilot for their daily work needs.

### Stage
Production - different users are utilizing AI technology regularly in their workflows

### Challenges
- Costs of AI usage are not insignificant and need to be managed
- Employees need to be properly trained to ensure compliant usage of the AI solutions and maximize their usefulness
- The speed at which AI technology advances makes it difficult to keep up, e.g., context window increases (tokens)
- Societal implications, e.g., risk of fraud and scams

### Source
Interview conducted in March 2024, led by sebis researchers. The two interviewees are both lawyers at the law firm.

AI Usage at a German Law Firm

## AI Solution Provider: Herlock Insights

-------------

### Who is using it?
The solution is targeted at law firms and legal professionals.

### What problem(s) are they solving?
The main focus is to provide transparency regarding legal case data, i.e., every legal case is self-contained and builds the foundation that the software solution operates upon. Users can query the documents for information and ask about information related to each case.

### Which NLP technologies are they using?
The company provides an AI-based case analysis tool called Herlock.ai ([https://www.herlock.ai/](https://www.herlock.ai/)) that uses natural language processing (NLP) and vector embeddings to analyze legal case data. The solution is provided as SaaS deployed on a private cloud running on GCP or AWS. One of the used language models is ChatGPT but the company is looking at alternatives that can be deployed on-premise for customers that have this requirement. The solution organizes relevant information around individual legal cases and provides a visual timeline of chronologically sorted events next to allowing to search and compare documents and ask questions about them.

### Challenges
- Hallucinations can occur but are mitigated by providing references to the sources of the information
- Legal landspace is very diverse and many users are still uncertain about employing AI in their workflow

### Source
Interview conducted in April 2024, led by sebis researchers. The interviewee is the co-founder and CTO of the company.

AI Solution Provider: Herlock Insights

## LLM Usage at a German Accounting Firm

-------------

### Who is using it?
The employees of a large German accounting firm with over 15.000 employees are exploring the usage of LLM-based tools to improve their efficiency.

### What problem(s) are they solving?
The employees use an LLM-based tool for document analysis, contract drafting, negotation assistance, and legal research. The most important use case for the users is document summarization, e.g., of contracts.

### Which NLP technologies are they using?
The employees are using Leah offered by ContractPodAI ([https://contractpodai.com/leah/](https://contractpodai.com/leah/)). ContractPodAI provides a contract lifecycle management suite and Leah is a standalone SaaS solution that enables the usage of generative AI without having to implement the full CLM solution. Leah provides various functionality out-of-the-box and utilizes multiple LLMs under the hood to generate its responses but it can also be fine-tuned to the needs of the customers.

### Stage
Production - users are using the tool in their daily workflow

### Challenges
- Continuous change management and data migration is required to keep up with new requirements
- Integration of the tool into the existing IT landscape
- Many lawyers are not very tech-savvy and require training to use the tool effectively

### Source
Interview conducted in May 2024, led by sebis researchers. The interviewee is the head of legal tech at the company.

LLM Usage at a German Accounting Firm

## Usage of an Anonymization Solution at Courts in the Canton of Aargau, Switzerland

-------------

### Who is using it?
The High Court of the Canton of Aargau in Switzerland with overall roughly 470 employees of which 124 are using an anonymization solution.

### What problem(s) are they solving?
The court wanted to publish court decisions but needed to anonymize sensitive data before being able to do so. Therefore, they chose Balo.ai ([https://www.balo.ai](https://balo.ai/)) which allows for the anonymization of text documents while preserving the readability of the document and keeping all data on-premise. Through the usage of the anonymization solution, the court was able to publish a lot more decisions than before (1673 in one year as opposed to roughly 100 in the past).

### Which NLP technologies are they using?
Balo.ai works with an on-premise language model so that no data ever leaves the environment the tool is used in, which is particularly beneficial from a data protection perspective as the target users are mostly public institutions in the legal sector who operate under strict data protection regulations. The model is specifically trained for anonymization tasks and doesn't require a lot of computing resources, which makes it possible to host it on machines with limited resources. Additionally, there is a MS Word Add-In that makes anonymization suggestions that the user needs to manually accept and a separate tool for PDFs with the same functionality.

### Stage
Production - the courts are using the solution for anonymization

### Challenges
- The LLM is not able to understand all legal terminology and ideally needs to be fine-tuned with specific data for the customer
- Users would like a fully automated process which is not trivial
- Integration of AI-based tools into existing office software (e.g., through plugins) is not trivial as new versions require adaptations (also because many companies use no longer supported legacy software)

### Source
Two interviews conducted in April and May 2024, led by sebis researchers, one with a co-founder of Balo.ai and one with a test manager working for the courts of the Canton of Aargau.

Usage of an Anonymization Solution at Courts in the Canton of Aargau, Switzerland

## AI Solution Provider: Elephant Labs

-------------

### Who is using it?
The solution is targeted at public institutions like the government, courts, and other regulatory offices. The company is currently in contact with the justice ministry of Bavaria to explore how the solution can provide value to them.

### What problem(s) are they solving?
The company Elephant Labs ([https://www.elephantlabs.ai/](https://www.elephantlabs.ai/)) was founded in December 2022 in an attempt to develop a solution that increases the efficiency of lawyers through the use of computer science. For example, court verdicts need to be published to the public but the regulations as to how and when are not clear. In order to publish such data, however, sensitive information needs to be masked first and this is what VerdictLLM was initially developed for.

### Which NLP technologies are they using?
The tool VerdictLLM utilizes the power of open-source LLMs and statistical methods to anonymize sensitive data. Additionally, the company uses embeddings to classify which information needs to be anonymized. The LLM is fine-tuned through synthetic data specifically optimized for applicability in the legal context.

### Challenges
- Establishing trust in LLM-based solutions with potential customers who primarily work with sensitive data
- Public institutions are reluctant to change existing processes (independent of AI)

### Source
Interview conducted in April 2024, led by sebis researchers. The interviewee is the founder of the company.

AI Solution Provider: Elephant Labs

## LLM Usage at a German Law Firm

-------------

### Who is using it?
A German law firm with roughly 180 employees has established a small legal tech lab and is exploring the usage of AI-based solutions to support their daily legal work. The department consists of 6 employees and is responsible for the digital transformation and legal tech strategy.

### What problem(s) are they solving?
The employees are trying to improve their knowledge management. The main goal is to make all relevant documents and data accessible through semantic search so that lawyers can easily find what they are looking for and then query these documents and receive appropriate responses from the AI. One example is to upload a document and ask for a summary of the decision. If the answer is not specific enough, the lawyer will ask a follow-up question to clear up any uncertainties. The users perceived big improvements in their efficiency as the solution is able to assist them in finding relevant information quicker than when looking for it themselves, especially considering that some cases consist of many documents which in turn consist of many pages. As LLMs may hallucinate responses, all users are urged to double check the generated responses.

### Which NLP technologies are they using?
The law firm is currently integrating Prime Legal AI ([https://primelegal.de/en/](https://primelegal.de/en/)) into their workflow. Depending on the use case, the AI solution utilizes multiple already existing LLMs (e.g., GPT-4, GPT-4-Turbo, Claude-3-Opus) under the hood to provide its various services. The users can select from a library of pre-defined prompts (or write their own) and the data they want them used upon. The anonymization functionality works on-premise whereas the rest of the functionality is available through the cloud. The service is accessible through a web application but also through an API. An entity-relationship model was used to train knowledge graphs which are the foundation for Prime Legal AI.

### Stage
Production - users are using the tool in their daily workflow

### Challenges
- Introduction of new tools requires training and marketing for the potential new users and ideally an IT department that takes care of the integration
- Data needs to be anonymized first before it can be fed into the tool
- Usage of AI leads to a paradigm shift from billing by the hour to a flat fee model

### Source
Two interviews conducted in May 2024, led by sebis researchers, one interviewee is the CEO of Prime Legal AI and the other is a lawyer specializing in corporate law and responsible for legal tech at their law firm.

## LLM Usage at a German Technology and Engineering Company

-------------

### Who is using it?
The patent department of a global technology and engineering company, which includes 26 direct employees and around 200 in total, is testing the usage of AI and LLMs to speed up their work.

### What problem(s) are they solving?
The employees use the LLM for various tasks surrounding text generation and analysis. Since September 2023, they are testing what is possible concerning patents including patent drafting, mapping of patents, and patent analysis, i.e., retrieving key aspects out of the documents. The results are perceived to be quite promising but one still needs to invest some time refining them as they are not good enough to just be copy pasted and used as is.

The initial expectation was that you can just give the LLM a job and wait for it to come back with the results. However, one key learning is that you need to teach the model what you want, i.e., give it a persona and break down the instructions into very small parts.

Further use cases revolve around assistance in their daily jobs such as drafting emails or parts of reports and translations.

In the future, they would like to expand their usage of LLMs by leveraging the voice input capabilities. Ideally, the LLM will act as a personal assistant helping with their daily tasks, e.g., answering questions, providing explanations, finding and opening files, etc.

### Which NLP technologies are they using?
The employees have access to ChatGPT 3.5 with 128k tokens through the company's Azure instance which provides a certain level of security and confidentiality.
The department is considering the costs and benefits of prompt optimization or the potential fine-tuning or even training of own models.

### Stage
Research - different users are experimenting with the usage of LLMs

### Challenges
- Context window insufficient - 128k tokens are not enough for working with large documents
- Domain-specific knowledge required - LLMs are not specialized enough for such a technical domain especially when it comes to novel technology that is not part of training data
- Fine-tuning / Training models requires necessary know-how and good training data

### Source
Interview conducted in June 2024, led by sebis researchers. The interviewee is a lawyer and head of the patent department at the abovementioned company.

LLM Usage at a German Technology and Engineering Company

## AI Solution Provider: fastlaw

-------------

### Who is using it?
The solution is targeted at law firms and notaries working with land registration data.

### What problem(s) are they solving?
The company fastlaw ([https://fastlaw.online/](https://fastlaw.online/)) was founded as a spin-off from a law firm that has been working completely digitally for the past ten years alreay. Their AI solution is designed to read land register data and extract relevant information.

### Which NLP technologies are they using?
The company provides a CRM solution for law firms and an AI-based tool called GREGOR available as a SaaS solution that is able to read land register data through OCR and then extract relevant information which in turn can be exported again in a structured format. To achieve this, the company together with an undisclosed partner trained their own language model.

### Challenges
- Adapting the AI to correctly identify the relevant text passages
- Land register data is not standardized and can consist of multiple document excerpts assembled into one single document

### Source
Interview conducted in April 2024, led by sebis researchers. The interviewee is the head of legal engineering and business development of the company.

AI Solution Provider: fastlaw

## AI Solution Provider: Libra Tech

-------------

### Who is using it?
The solution is targeted at law firms and legal professionals.

### What problem(s) are they solving?
Libra ([https://libratech.ai/](https://libratech.ai/)) wants to become an AI-powered law firm assistance provider to increase the efficiency of lawyers. For example, the tool is able to classify and extract information from documents and generate new documents like contracts.

### Which NLP technologies are they using?
The company is currently building modules in an AI pipeline to automate different tasks in a lawyer's workflow. They started out with using commercial APIs like ChatGPT but then proceeded to fine-tune their own models that will be used exclusively in the future. The solution is under active development and the company is building their own evaluation data sets while simultaneously receiving feedback from customers to evaluate their application.

### Challenges
- Compliance requirements
- Acquiring high-quality training data to fine-tune models to the legal domain
- Aligning the technical side with the business side

### Source
Interview conducted in April 2024, led by sebis researchers. The interviewee is a co-founder and the CTO of the company.

AI Solution Provider: Libra Tech

## LLM Usage at a Global Law Firm

-------------

### Who is using it?
The Mergers and Acquistions department of a large international law firm with roughly 70 lawyers in Germany (900 globally) is exploring the usage of AI in their daily work. The law firm has a global technology committee consisting of multiple employees including the CIO that evaluates new technologies and makes executive decisions about adopting them into the firm.

### What problem(s) are they solving?
The employees are using AI-based tools for document analysis, information extraction, and translation. They believe AI tools will eventually replace a lot of the work that is nowadays being done by junior associates.

### Which NLP technologies are they using?
The department is using Kira ([https://kirasystems.com/](https://kirasystems.com/)) for document analysis and information extraction from legal documents like contracts. The firm has access to its own instance running the software to ensure the confidentiality of the data.
For translations the lawyers use DeepL ([https://www.deepl.com/](https://www.deepl.com/)), an AI-based translation tool specifically trained for translation tasks.
Furthermore, the firm also tested ChatGPT but deemed it not good enough to be used as-is in their daily professional work and is now evaluating Harvey ([https://www.harvey.ai/](https://www.harvey.ai/)) for document analysis.

### Stage
Production - AI-based tools are used regularly in their legal work

### Challenges
- Ensuring GDPR compliance and confidentiality
- Trust in AI systems needs to be established
- Support for multiple languages is important for an international firm
- Not enough use cases (at the time of the interview) to justify large investments in AI
- Rethinking of business model (hourly billing vs. flat fee) might be necessary if AI increases efficiency

### Source
Interview conducted in February 2024, led by sebis researchers. The interviewee is a lawyer working in Mergers and Acquistions at a large law firm.

LLM Usage at a Global Law Firm

## AI Usage at a German Publishing Group

-------------

### Who is using it?
A large publishing group with its own legal department consisting of 6 lawyers is evaluating the usage of AI tools for their daily legal work.

### What problem(s) are they trying to solve?
The employees have access to a company-wide chatbot that was developed in-house and that they can use for their daily work. The use cases include:
- Document analysis
- Document summarization
- Text generation (e.g., email, rephrasing)
- Translation
- Question Answering
- Research

### Which NLP technologies are they using?
The company chatbot is based on models from OpenAI but does not have access to the internet or company data directly. However, users can upload documents through the chatbot interface to use them in ensuing prompts.
The company is also testing Semantha ([https://www.semantha.de/](https://www.semantha.de/)) for document analysis and semantic search.

### How do they test the quality of the tools?
The legal professionals do not have a predefined set of evaluation metrics but come together regularly to discuss the usage of AI and other relevant topics revolving around AI. The general sentiment is that there is a lot of potential in AI solutions but we are still just at the beginning and the tools currently do not work satisfactorily enough yet.

### Stage
Production - employees use company-wide chatbot for their daily work

### Challenges
- Hallucinations - LLMs do not always produce accurate information
- Finding the right AI solution(s) for each use case
- Ensuring that employees understand how to use the chatbot effectively through proper training
- Ensuring that company data is not used for AI training

### Source
Interview conducted in March 2024, led by Prof. Dr. Florian Matthes and Nektarios Machner. The interviewee is working at the firm's legal department as a lawyer with a focus on IT.

AI Usage at a German Publishing Group

## AI Usage at a German Law Firm

-------------

### Who is using it?

A large law firm with over 100 lawyers and accountants organized in teams of 10-12 employees distributed over 3 locations is in the process of evaluating legal AI usage at their firm. The target audience of the tools are the lawyers.
As of the date of the interview, the law firm has not yet adopted any company-wide legal AI solution but is testing various tools and models in a decentralized way to determine in which cases an adoption is feasible. Some lawyers already use personal ChatGPT accounts to assist them in their daily tasks.

### What problem(s) are they trying to solve?

The employees are in the phase of testing and figuring out what problems related to the legal domain can feasibly be solved with the usage of LLM-based tools.
Some lawyers already use personal ChatGPT accounts as a personal assistant to assist them in their daily tasks which are not restricted to the legal domain such as creating and summarizing texts (e.g., emails) or helping with translations, etc.
Regarding the legal use cases, due to the decentralized nature of the law firm the respective tasks of each department are diverse.
The use cases under investigation include but are not limited to:
- Document generation
- Document analysis of large(r) collections of documents
- Document summarization
- Information research and retrieval

### Which NLP technologies are they using?

The law firm is looking at various tools on the market, especially ones also being used by other German law firms, to get an overview of the current tool landscape. The solutions under investigation mainly operate with OpenAI and LLaMa models and are either deployed in the cloud or on-premise. In general, the law firm would prefer an on-premise solution to maintain control over the service. The language requirements are German and English. There is no intention of building their own tools but rather wait for the establishment of market standards that can then be adopted into their own IT landscape.

### How do they test the quality of the tools?

Since the rise of LLMs there have been multiple individual uncoordinated tests of LLM usage on a personal level but in the past few months an effort has been made to coordinate the testing and conduct it in a more organized way.
For this purpose, the various departments of the law firm individually test tools regarding their feasibility for their respective use cases. The employees do not use any specific evaluation metrics but come together and define success criteria and test scenarios for each task and then later on get together in working groups to discuss the findings.

### How is data privacy cared for?

No privacy-sensitive data is used for testing to avoid any privacy-related issues.

### Stage

Research - different users are experimenting with the usage of AI

### Challenges

- Commercial / Effort - For a revenue-driven firm the willingness to expend resources on adopting a new solution is limited as it requires additional effort for data preparation and testing before a solution can be integrated into the existing IT landscape.
- Privacy issues - Data fed into the model should not be used for training. For older data (historic data) there are no privacy agreements that allow the usage of the data in such tools.
- Compliance with AI Act

### Source
Interview conducted in February 2024, led by sebis researchers. The interviewees are working at the law firm in the position of lawyer and Digital Transformation Manager respectively.

## AI Solution Provider: Hyde

-------------

### Who is using it?
The solution is targeted at law firms and legal professionals.

### What problem(s) are they solving?
The motivation to focus on the legal sector stems from the fact that legal professionals primarily work with text which is predestined to being used with large language models. The offered AI suite aims to assist with multiple legal use cases including case management, document analysis, and document generation based on custom templates specific to the customer.

### Which NLP technologies are they using?
Hyde ([https://www.hyde.to/](https://www.hyde.to/)) is an AI suite based on language models. The company transitioned from building one large language model into building multiple smaller models specific for individual use cases such as semantic search to query documents for information. The solution is offered as SaaS in the cloud or on-premise depending on the customer's need.

### Challenges
- Customer acquisition is not easy in the legal domain as law firms are focused on their work and tend to not have much time for sales calls

### Source
Interview conducted in May 2024, led by sebis researchers. The interviewee is a late co-founder and the CPO at the company.

AI Solution Provider: Hyde

## AI Solution Provider: Justin Legal

-------------

### Who is using it?
The solution is targeted at law firms and legal professionals.

### What problem(s) are they solving?
The company focuses on data collection and data quality to enable digitalization. Clients of law firms can use the solution to provide relevant data for their case in a structured form by following the steps in the tool. Lawyers are then able to review the data digitally and ask questions about the document to the AI assistant.

### Which NLP technologies are they using?
Justin Legal ([https://justin-legal.com/](https://justin-legal.com/)) provides their service through a SaaS web application. The underlying LLM is ChatGPT 4 deployed on an Azure instance which is used to provide features like text summarization and question & answering. The data can be used to generate new documents, export in various formats, or directly passed via API to standard software solutions.

### Challenges
- Properly modeling legal real-world scenarios in a digital system
- GDPR Compliance

### Source
Interview conducted in May 2024, led by sebis researchers. The interviewee is the CEO at the company.

AI Solution Provider: Justin Legal

## AI Solution Provider: Neur.on AI

-------------

### Who is using it?
The solution is targeted at professionals from the legal and financial sector.

### What problem(s) are they solving?
The company Neur.on AI ([https://neur-on.ai/](https://neur-on.ai/)) specializes in translations and translation management.

### Which NLP technologies are they using?
The company currently provides multiple separate solutions like Lex Machina and Corrext that they eventually want to integrate into one overarching software solution. The solution is offered as a collaborate SaaS solution accessible through a web application. The system preprocesses data with the help of multiple LLMs, e.g., to categorize what kind of law documents pertain to, and then the system can provide machine translations but also humans can collaborately check the results and work on creating the translations through a web interface manually. The models were trained specifically for legal and financial terminology.

### Challenges
- Ensuring confidentiality of the data

### Source
Interview conducted in May 2024, led by sebis researchers. The interviewee is the COO at the company.

AI Solution Provider: Neur.on AI

## LLM Usage at a German Law Firm

-------------

### Who is using it?
The legal tech department of a German law firm is developing and using an AI-based solution for their daily legal work. The department is responsible for legal operations and tries to model legal processes as a series of steps that can be automated with software solutions.

### What problem(s) are they solving?
The motivation for the solution was an ever increasing influx of legal correspondence that took too much time sorting through and properly linking it to the respective cases.
Using an AI-based solution to go over all incoming correspondence automatically improves their efficiency since documents are classified and information like deadlines is extracted automatically.

### Which NLP technologies are they using?
The law firm uses Salesforce as CRM where they integrated their AI solution through multiple complex workflows. The solution Blaubach.ai ([https://www.blaubach.ai/](https://www.blaubach.ai/)) was specifically developed for internal use first but is now also offered to other interested parties and can be adapted to their specific needs.
The general workflow is that incoming data is passed through the AI solution that automatically detects the docket number and extracts relevant information from the document assigning it to the correct case.
The lawyers annotated the training data themselves and handed the labels off to the data scientists in the team to adapt the AI.

### Stage
Production - users are using the tool in their daily workflow

### Challenges
- The tool occassionally makes mistakes that need to be double-checked manually by humans
- Integrating new solutions into the existing legal IT landscape and adapting it to existing APIs is not trivial

### Source
Two interviews conducted in April 2024, led by sebis researchers, one interviewee is a lawyer and the head of the legal tech department at the company, the other is a data scientist.

## LLM Usage at a German Healthcare Solution Provider

-------------

### Who is using it?

A team of several in-house legal experts from a multi-national, German-based technical corporation specializing in healthcare solutions and services. 300 users are currently testing the usage of MS Copilot.

### What problem(s) are they solving?

The employees use LLM-based tools for various tasks in their daily work life. For one as a personal assistant for various tasks including quick general questions, translations, summaries of text, and searching for specific files on the system. Another task can be summed up under the umbrella term of content generation, e.g. for email drafts, marketing texts, etc.

The rise in popularity of ChatGPT led legal experts at the company to evaluate if they could also harness the power of LLMs to assist in the daily, routine work of legal contract generation and analysis, which typically requires a great deal of manual time and human effort. The usage of LLMs can help highlight important parts of contracts and give guidance on where a human expert should have a closer look. The contracts are based primarily on German law. Other legal tasks are also being considered.

Another emerging use case is the usage of LLMs to assist in software development wherefore it's currently being tested regarding legal regulations.

Finally, the organization is thinking about deploying chatbots to assist in the communication with customers which could result in a reduction of costs.

### Which NLP technologies are they using?

As a technical-oriented organization, employees already had existing access to the Microsoft Office products, which facilitated for the convenient experimentation with MS Copilot and ChatGPT on the Microsoft Azure Cloud. This cloud solution was chosen due to its ease of use, as well as the perceived privacy of using ChatGPT in the cloud, with no need for further training or fine-tuning on proprietary data. Prompt engineering is employed to optimize results.

Software engineers are also evaluating open-source models for generating code and documenting it automatically.

### How do they test the quality of their service?
The organization started using the ChatGPT playground in summer 2022. Before that, interested parties experimented with their personal ChatGPT accounts and non-sensitive data, subject to guidelines provided by the organization. The employees do not employ any prompt engineering guides on department level or use any evaluation metrics to determine the effectiveness of the model. The experts manually test the models for their various tasks to determine if their usage for the respective use cases makes sense. One finding is that the more the respective field is legally regulated, the less sense it makes to employ AI, e.g. German lease contracts are too strictly regulated so that LLMs struggle with producing accurate and correct results.

### How is data privacy cared for?
Documents are anonymized manually before uploading them to the cloud and making them accessible to the model.
Usage of the public ChatGPT interface is only allowed for non-privacy sensitive matters. For everything else the ChatGPT playground needs to be used as Microsoft claims to not use that data for training purposes.

### Stage
Research - different users are experimenting with the usage of LLMs

### Barriers to Adoption
- Hallucinations -– Quality, reliability, and correctness of generated responses varies depending on use case.
- Copyright infringement and ensuing liability risk - It's not always clear whether generated responses from the model contain copyrighted content.
- Privacy issues - Data fed into the model should not be used for training.


### Source
Interview conducted in January 2024, led by Prof. Florian Matthes and Nektarios Machner. The interviewee is a lawyer and responsible for the IT department at the abovementioned company, where he also looks into what is going on in the IT world regarding useful tools.

LLM Usage at a German Healthcare Solution Provider

## AI Solution Provider: 913.ai

-------------

### Who is using it?
The solution is targeted at legal service providers.

### What problem(s) are they solving?
913.ai ([https://www.913.ai/](https://www.913.ai/)) wants to provide an automation infrastructure that allows users (e.g., legal engineers) to connect various already existing tools in a law firm with each other. Use cases include but are not limited to document classification and information extraction. The solution aims to represent and assist in typical workflows in the daily legal work of lawyers.

### Which NLP technologies are they using?
913.ai uses open-source LLMs but also fine-tunes their own models for specific tasks like text extraction or classification. They offer a pipeline builder that allows users to select and link various modules together to depict their own unique scenarios as they need them. They are currently adding more modules and improving already existing ones to make them more adaptable by the users.

### Challenges
- GDPR Compliance
- Gaining new customers as customers in the legal domain tend to be more averse to cloud solutions

### Source
Interview conducted in April 2024, led by sebis researchers. The interviewee is a lawyer, co-founder and the CEO of the company.

AI Solution Provider: 913.ai

## AI Usage at a German Law Firm
-------------

### Who is using it?
A German law firm with roughly 120 lawyers is exploring the use of AI in their daily legal work. The firm put together an AI Task Force consisting of multiple lawyers from the firm to evaluate AI-based tools regarding their applicability in their daily workflow.

### What problem(s) are they trying to solve?
The main use cases are document analysis and document generation, e.g., for documents submitted by a party in a legal proceeding or to create pitch decks. Further use cases include translation and general research. To assist with cases concerning intellectual property, an AI-based tool is used to do similarity analysis, e.g., comparing two logos or design.

Overview of use cases:
- Document analysis
- Document generation
- Translations
- Research
- Similarity Analysis

### Which NLP technologies are they using?
The law firm is currently evaluating ChatGPT to find out what for and how it can be used in their legal work. Additionally, Microsoft's Copilot is being explored as a personal assistant, e.g., to search for specific files on the file system. DeepL Pro ([https://www.deepl.com/](https://www.deepl.com/)), an AI-based translation tool specifically trained for translation tasks, is used for translations.

### How is data privacy cared for?
No privacy-sensitive data is used for testing to avoid any privacy-related issues.

### Stage
Production - lawyers use AI-based tools for their daily legal work

### Challenges
- Hallucinations - LLM output cannot be used as-is but needs to be double-checked and verified
- A lot of interesting AI solutions are put on the market but there is no proper overview to keep track of developments
- GDPR compliance, privacy and confidentiality need to be ensured
- AI solutions need to be integrated properly into the existing IT landscape and processes, which is not trivial for law firms without or with only a small IT department

### Source
Interview conducted in February 2024, led by sebis researchers. The interviewees are working as lawyers at the law firm.

Syntactic analysis, also known as parsing, involves analyzing the grammatical structure of sentences to understand relationships between words. The fundamental purpose of syntactic analysis is to derive meaning from a text. In the analysis, checks are in place so that texts which are not meaningful or which do not make sense can be rejected. The analysis is done at an in-depth level starting from the basic symbols to all the way to an entire sentence. The concept is of critical importance since it enables machines to understand human language. It plays an instrumental role in bridging the gap between humans and systems. Example NLP techniques for syntactic analysis include dependency parsing, construction of a syntax tree, or part-of-speech tagging.

Syntactic Analysis

Lexical Normalization

Tokenizations

Dependency Parsing

Part-of-speech tagging

Text extraction is the process of pulling specific information or data from unstructured text. As machines need the information to be in a structured form, for example in a table, text extraction serves to identify relevant information in unstructured text and transforms it into a type of structured information that is easier to process. The goal of text extraction or information extraction (IE) is to make the text’s semantic structure explicit so that we can make use of it. More precisely, it is the process of analyzing text and identifying mentions of semantically defined entities and relationships within it. The entities and relationships that are of interest can be detected and extracted with NLP techniques involving named entity recognition, relation extraction, or event extraction.

Text Extraction

Named Entity Recognition

Keyword Extraction

Document analysis encompasses techniques for understanding and processing entire documents. It refers to the process of systematically examining meaningful information from text documents and deriving use and added value from them. Document analysis is crucial within NLP as it enables the automation of understanding and organizing large volumes of text data, transforming unstructured data into structured insights. This capability is essential for various applications, including information retrieval, customer feedback analysis, legal document review, and content recommendation systems.

Document Analysis

Entity Linking/Named Entity Disambiguation

Document Similarity Analysis

Text representation involves converting text into numerical vectors or embeddings that machine learning models can work with. These representations should ideally capture the semantic and syntactic nuances of the language. Effective text representation is crucial because it directly influences the performance of all downstream NLP tasks, such as document retrieval, sentiment analysis, or text classification. Good representations preserve the meaning and context of the text, enabling models to learn patterns and make accurate predictions. Basic approaches include techniques such as Bag-of-Words (BoW) and inverted indices. Advanced techniques like word embeddings (e.g., Word2Vec, GloVe) and contextual embeddings (e.g., BERT, GPT) have significantly improved the ability of models to understand and generate human language, highlighting the importance of sophisticated text representation in achieving state-of-the-art results in NLP.

Text Representation

Word Embedding

Language Modeling

Text generation involves constructing new textual content by automatically producing words, sentences, and documents. This task is in the legal domain often approached with rule-based techniques that leverage templates, i.e., pieces of pre-filled text that serve as the backbone of a document that will be constructed. Modern large language models have tremendously improved the generative capabilities and are a commonly used tool for quickly producing and refining long textual outputs. Text generation encompasses many NLP tasks such as summarization, translation, simplification, and paraphrasing.

Text Generation

Text Summarization

Machine translation

Conversational AI or conversational NLP refers to technologies, such as chatbots or virtual agents, that users can talk to. They use large volumes of data, machine learning and natural language processing to help imitate human interactions, recognizing speech and text inputs and translating their meanings across various languages. These NLP processes flow into a constant feedback loop with machine learning processes to continuously improve the AI algorithms. Conversational agents can be used to assist end users with various tasks and needs. NLP techniques involve dialogue state tracking and natural language understanding of user intents.

Conversational NLP

Chatbot Development

Question Answering

Text classification categorizes text documents into predefined classes or labels. It's applied in tasks like sentiment analysis, spam detection, and topic classification, helping automate content sorting and analysis. Text classifiers can structure, arrange, and classify almost any type of text, including articles, medical research, and customer tickets, as well as text found on the internet. By automating the classification of text, organizations can efficiently process and organize large volumes of data, extract valuable insights, and enhance decision-making processes.

Text Classification

Topic Modeling

Concept Models

As the field of Natural Language Processing is highly diverse and continually expanding, not all identified technologies could be conveniently placed into one of the above NLP Technology categories. Therefore, we place two technologies in this final category, namely NLP in General and Version Control. With the former, we hope to capture NLP papers not necessarily introducing new technologies, but rather those that provide surveys or meta-analyses.

Other

NLP in general

Version Control

Compliance and risk management play a large role in today’s legal sphere, especially considering important key regulations such as GDPR. In processes such as auditing or conducting risk assessments, NLP technologies can help to reduce cumbersome tasks, while still maintaining the rigor required to carry out such processes.

Compliance and Risk Management

Automation of Auditing

GDPR Compliance

Risk Assessment

Legal professionals must handle many collections of documents in order to conduct their daily work. In addition, they must be able to analyze and understand the contents of this material. Dealing with masses of documents may be overwhelming, but leveraging Legal Tech solutions, this process may become more manageable. Use cases including file version tracking or document classification encompass this category, amongst others.

Document Analysis and Management

File Difference Tracking

Document Classification

Content Lifecycle Management

Error Detection

Document generation encompasses all use cases referring to creating new documents from scratch, summarizing long documents, or enriching existing documents by inserting valuable information. This includes contract generation, e-mail drafting, creating mass trial requests, deadline management, etc.

Document Generation and Assistance

Contract Generation

Legal Document Enrichment

Summarization

Deadline Management

E-Mail

Class Action Lawsuits

Information processing is an important category of legal technology comprising all use cases that extract valuable insights from documents, anonymizing sensitive information of clients, transcribing spoken word to textual format, and any other form of processing data from one type to another.

Information Processing and Extraction

Anonymization / Text Scrubbing

Information Extraction

Document Retrieval

Transcription

Legal professionals use legal argumentation, reasoning, and logic to make decisions related to legal matters, such as court rulings or dispute resolution. Legal technology can assist by recommending the best strategies and logical reasoning based on background legal knowledge and principles.

Legal Decision Making and Dispute Resolution

Judge: Decision Making

Legal Reasoning

Strategy Recommendations

Dispute Resolution Mechanism

Legal technology can support both legal practitioners and clients by retrieving important information from legal knowledge sources, answering questions and concerns, translating documents in foreign languages. Additionally, databases of lawyers can help the general public get access to justice, and assess the credibility of witnesses for court processes

Legal Information Retrieval and Support

Chatbot

Ranking of Laywers

Credibility of Witnesses

Translation

Whether preparing for court and reading up on past cases, performing legal research is crucial to a legal professional’s daily work. Not only does finding such cases present a challenge, but managing this information as well does not come without hurdles. The use cases in this category comprise of useful tools and technologies that serve to assist in making the research process more efficient and streamlined. 

Legal Research and Information Management

Changes in Law

Database for Court Decisions

Law Systems Divergence

Research Tool / Research Automation

e-Discovery

The tasks of a legal professional are not limited to the categories listed in this collection. Instead, many other tasks may benefit from automation or the incorporation of NLP solutions. Processes such as matter management or legal hold are some examples of common legal activities which may be well served to automate and expedite. 