Thursday, March 6, 2025

AI "Deep Research" on UFO topics: Now better than average human? (Sample AI reports: Bob Lazar, Richard Doty, Rendlesham, Cash Landrum, Gulf Breeze)

Section A: Introduction

I think this is pretty big news for UFO research.  A tipping point has now been reached.

I do not expect this development "soon". It is not "imminent". I mean NOW.

In the last few weeks, AI "Deep Research" reports on UFO issues have reached the point that they are better than the average UFO website created by humans.  

I would not have said the same about the output from any AI model just a month ago.

These "Deep Research" reports are still (as with most UFO websites created by humans...) very far from perfect. But the rate of progress is now considerable.

The recent releases of "Deep Research" tools by various AI companies offer hope for rapid further progress in the quality of automated UFO research in the near future. 

I've created a new relevant library in my online UFO archive and have uploaded some sample "Deep Research" reports from:

(1) ChatGPT Deep Research

(2) Perplexity Deep Research

(3) Grok 3 Deep Research


I've invited a few (human) subject matter experts to comment on AI Deep Research reports relating to their particular areas of UFO research (such as Curt Collins on the Cash Landrum incident).

My own (very impressionistic and subjective...) approximate quantitative ratings are:

(1) ChatGPT o3 Deep Research: 5/10 (sometimes 6/10)

(2) Perplexity Deep Research: 4/10

(3) Grok 3 Deep Research: 3/10

(4) Average human UFO website: 4/10

(5) Average UFO page on Wikipedia: 5/10 (sometimes 6/10)


I discuss some potential next steps below (in addition to a more immediate, short-term potential collaborative project that I'd like to see completed in the next few days).  

As detailed in Section D below, anyone else interested in UFOs can help (and I've created a disposable Discord group to coordinate this) if they are :
(A) willing to create a free account with Perplexity or use Grok on Twitter, OR  
(B) a ChatGPT Plus (or Pro...) user.

For anyone wishing to be involved in that short-term collaborative project, I include step-by-step screenshots below in Section D for each of the three relevant AI models. I'm happy to help further here or in  a disposable Discord group I've created for this purpose there are basically just 3 steps (and they are fairly simple):

(1) Go to the relevant AI website and select "Deep Research" (Perplexity and Grok are free but with limits per person, ChatGPT currently requires a membership for Deep Research but this is due to change soon),

(2) Enter a query: Copy and paste the standard prompt from Section C below, just changing the keyword to change the topic upon which a Deep Research report is to be generated,

(3) Share the resulting report: Either select (a) an option to share a link for the resulting report and then just post the link, or (b) [ideally...] copy the report from the AI website using the copy icon at the end of the report and then paste the copy of the report into the free PDF generator at https://www.deepresearchdocs.com/, download the PDF then attach the PDF to a message in the disposable Discord group (or email it to me at isaackoi@gmail.com). 

In Step 3, option (a) will probably be easier for most people. I'm willing to deal with generating and uploading the PDF version... 


This post includes:

Section A : This introduction

Section B : Some samples of current "Deep Research" reports

Section C : A standard prompt I've developed to generate such reports

Section D : Details of a short potential collaborative project to build a library of such reports

Section E : Some potential next steps for developing better AI tools for use within ufology

Section F : Comments from various Subject Matter Experts on the sample reports.



Section B : Some samples of current "Deep Research" reports

Individuals - Bob Lazar:

AI - 2025 - ChatGPT o3 Deep Research - Individuals - Bob Lazar

AI - 2025 - Perplexity Deep Research - Individuals - Bob Lazar



Individuals - Richard Doty: 

AI - 2025 - ChatGPT o3 Deep Research - Individuals - Richard Doty

AI - 2025 - Perplexity Deep Research - Individuals - Richard Doty



Cases - Rendlesham:

AI - 2025 - ChatGPT o3 Deep Research - Cases - 1980 12 - Rendlesham

AI - 2025 - Perplexity Deep Research - Cases - 1980 12 - Rendlesham

AI - 2025 - xAI Grok 3 Deep Research - Cases - 1980 12 - Rendlesham


Cases - Cash Landrum: 

AI - 2025 - ChatGPT o3 Deep Research - Cases - 1980 12 29 - Cash Landrum

AI - 2025 - Perplexity Deep Research - Cases - 1980 12 29 - Cash Landrum

AI - 2025 - xAI Grok 3 Deep Research - Cases - 1980 12 29 - Cash Landrum

 

Cases - Gulf Breeze:

AI - 2025 - ChatGPT o3 Deep Research - Cases - 1980s - Gulf Breeze

AI - 2025 - Perplexity Deep Research - Cases - 1980s - Gulf Breeze

AI - 2025 - xAI Grok 3 Deep Research - Cases - 1980s - Gulf Breeze

 

Documents - MJ12:

AI - 2025 - ChatGPT o3 Deep Research - Documents - MJ12

AI - 2025 - Perplexity Deep Research - Documents - MJ12

AI - 2025 - xAI Grok 3 Deep Research - Documents - MJ12


Countries - Greece:

AI - 2025 - Perplexity Deep Research - Countries - Greece

AI - 2025 - xAI Grok 3 Deep Research - Countries - Greece


Other topics - USOs:

AI - 2025 - ChatGPT o3 Deep Research - Other - USOs - Unidentified Submerged Objects

AI - 2025 - Perplexity Deep Research - Other - USOs - Unidentified Submerged Objects

AI - 2025 - xAI Grok 3 Deep Research - Other - USOs - Unidentified Submerged Objects



Section C : Standard prompt and PDF generator

I've developed a standard prompt so that new reports can be generated just by cutting and pasting this text into the prompt for any of the AI Deep Research tools and just changing the keyword at the beginning of the query.   

Keyword = Rendlesham
I would like a detailed and critical evaluation of the available evidence relating to this topic/individual, specifically in the context of claims about Unidentified Flying Objects (UFOs) and related phenomena.
Please address the following:
(1) Historical and factual background – Provide an overview of the key events, claims, and sources related to this topic/individual.
(2) Credibility assessment – Evaluate the reliability of primary sources, whistleblower testimony, scientific studies, and government/military disclosures.
(3) Counterarguments and skepticism – Summarize key criticisms, debunking efforts, and alternative explanations.
(4) Influence and impact – Discuss how this topic/individual has shaped public perception, government policy, and the broader UFO discourse.
(5) Sources and follow-up research – List primary documents, reports, books, and expert opinions that could be further investigated to clarify unresolved aspects.
(6) Please ensure that sources are cited and that both believers' and skeptics' perspectives are represented fairly. If there are key gaps in evidence, suggest avenues for follow-up research that could help resolve lingering uncertainties.
I want an integrated report rather that one that addresses the above points individually.
Please prioritize the most detailed and critical research.
Please adopt an evidence-based approach.
Please keep a strong focus on the keyword above, rather than UFOs (or other topics) generally.

I've also been working to find tools to quickly convert the output to searchable PDFs.  

(You don't have to worry about generating a PDF as, with each model, you can just share a link to the relevant Deep Research report - see screenshots below for each model - and I'll create the PDFs and make them freely available online as long as the above standard prompt is used).  

If you want to keep a PDF copy (or reduce my workload...) you can use a free tool online at: https://www.deepresearchdocs.com/

The tool at https://www.deepresearchdocs.com/ makes it easy (and free) to create a relevant PDF. (Perplexity has an option to save Deep Research reports as PDFs, but this other tool is actually better than Perplexity's own option...). The steps to use this tool are:

(1) Copy and paste the Deep Research report from the relevant AI website into the box marked A in screenshot below.
(2) Generate the PDF by click the box marked B in the screenshot below.
(3) Download that PDF by click the box marked C in the screenshot below.  (Don't worry about the file name - I will rename any PDFs sent to me or upload to the disposable Discord group).






Section D : Short potential collaborative project to build a library of such reports 

I think it is worth pulling together more samples of such Deep Research into a freely available new relevant library online in my free online UFO archive. 

To pull together a small library of Deep Research reports from current online models, a bit of collaboration would be great. Several AI models have limits on the number of "Deep Research" queries you can do (10 per month on ChatGPT Plus...) and they can take about 10 minutes per report to be generated, so spreading the workload a bit would allow much faster creation of a representative sample of Deep Research reports. 

I currently pay for one AI "Deep Research" tool (on ChatGPT Plus) and also use "Deep Research" on the the free level of various other AI tools (particularly Perplexity's Deep Research and Grok 3's Deep Research).

Anyone else interested in UFOs can help if they are :
(A) willing to create a free account with Perplexity or use Grok on Twitter.  
(B) a ChatGPT Plus (or Pro...) user.

I'm willing to help organise a very short collaborative project during the next few days.

Coordination in a new disposable Discord group (open invitation link HERE) would, I think, be easiest/fastest - with a view to abandoning the new group within a few days. I've just set up a new group...

Anyone else interested in UFOs can help if they are :
(A) willing to create a free account with Perplexity or use Grok on Twitter, OR  
(B) a ChatGPT Plus (or Pro...) user.

For anyone wishing to be involved, I include below step-by-step screenshots for the three AI models (and am happy to help here or in the disposable Discord group I've created for this purpose), but there are basically just 3 steps (and they are fairly simple):

(1) Go to the relevant AI website and select "Deep Research" (Perplexity and Grok are free but with limits per person, ChatGPT currently requires a membership to generate any Deep Research reports but this is due to change soon),

(2) Enter a query: Copy and paste the standard prompt from Section C, just changing the keyword to change the topic upon which a Deep Research report is to be generated,

(3) Share the resulting report: Either select (a) an option to share a link for the resulting report and then just post the link, or (b) [ideally...] copy the report from the AI website using the copy icon at the end of the report and then paste the copy of the report into the free PDF generator at https://www.deepresearchdocs.com/, download the PDF then attach the PDF to a post in the disposable Discord group (or just email it to me at isaackoi@gmail.com and I'll sort it out). 

In Step 3, option (a) will probably be easier for most people and I'm willing to deal with generating and uploading the PDF version... 







Section D1 : ChatGPT Deep Research

ChatGPT's Deep Research is online at: 
https://chatgpt.com/

ChatGPT's Deep Research is currently only available to those paying for membership of ChatGPT Plus and ChatGPT Pro (although OpenAI has indicated that free users will soon be able to do a very limited number of searches per month).  

I am a ChatGPT Plus user, but we are limited to 10 searches per month per user - so this is the model in relation to which some collaboration would be most desirable.

I'm sure many of the people interested in UFOs on Twitter and elsewhere have a ChatGPT Plus account, so hope a few people will help out increasing the size of the relevant free online library of Deep Research reports from ChatGPT...

Sample reports by ChatGPT o3 Deep Research (2025):

(1) Go to https://chatgpt.com/ and select "Deep Research":

(2) Enter a query: Copy and paste the standard prompt from Section C, just changing the keyword to change the topic upon which a Deep Research report is to be generated.  (You can then use your computer for other tasks while the Deep Research report is generated, which usually takes about 10 minutes at present on ChatGPT).


(3) Share the resulting report: Either 
(a) click on the "Share" button at the end of the report (i.e. the button marked "A" in the screenshot below) and then just post share a link for the resulting report on Twitter or in the disposable Discord group, OR 
(b) [ideally...] copy the report from the AI website using the copy icon at the end of the report (i.e. the button marked "B" in the screenshot below) and then paste the copy of the report into the free PDF generator at https://www.deepresearchdocs.com/, download the PDF then attach the PDF to a message in the disposable Discord group (or email it to me at isaackoi@gmail.com). 

In Step 3, option (a) will probably be easier for most people. I'm willing to deal with generating and uploading the PDF version... 




If you went for Option B in Step 3, go to https://www.deepresearchdocs.com/ and use the free tool there to create a relevant PDF.  The steps to use this tool are:

(1) Copy and paste the Deep Research report from the relevant AI website into the box marked A in screenshot below.
(2) Generate the PDF by click the box marked B in the screenshot below.
(3) Download that PDF by click the box marked C in the screenshot below.  (Don't worry about the file name - I will rename any PDFs sent to me or upload to the disposable Discord group).



Section D2 : Perplexity Deep Research

Perplexity's Deep Research is online at:
https://www.perplexity.ai/

Anyone can use Perplexity to generate Deep Research reports for free (up to a daily limit).

Sample Reports by Perplexity Deep Research (2025):

AI - 2025 - Perplexity Deep Research - Individuals - Bob Lazar

AI - 2025 - Perplexity Deep Research - Individuals - Richard Doty

AI - 2025 - Perplexity Deep Research - Cases - 1980 12 - Rendlesham

AI - 2025 - Perplexity Deep Research - Cases - 1980 12 29 - Cash Landrum

AI - 2025 - Perplexity Deep Research - Cases - 1980s - Gulf Breeze

AI - 2025 - Perplexity Deep Research - Other - USOs - Unidentified Submerged Objects

AI - 2025 - Perplexity Deep Research - Documents - MJ12

To generate a "Deep Research" report on Perplexity:

(1) Go to https://www.perplexity.ai/ and select "Deep Research" from the drop down memo (which may show the word "Auto" when you load that webpage).

(2) Enter a query: Copy and paste the standard prompt from Section C, just changing the keyword to change the topic upon which a Deep Research report is to be generated.  (You can then use your computer for other tasks while the Deep Research report is generated, which usually takes about 5 minutes at present on Perplexity).



(3) Share the resulting report: Either 
(a) click on the "Share" button at the end of the report (i.e. the button marked "A" in the screenshot below) and then just post share a link for the resulting report on Twitter or in the disposable Discord group, OR 
(b) [ideally...] copy the report from the AI website using the copy icon at the end of the report (i.e. the button marked "B" in the screenshot below) and then paste the copy of the report into the free PDF generator at https://www.deepresearchdocs.com/, download the PDF then attach the PDF to a message in the disposable Discord group (or email it to me at isaackoi@gmail.com), OR
(c) As a last resort you could export as a PDF (using the button marked C in the screenshot below) BUT Perplexity's own tool for creating a PDF is, well, not good.  Either of the other options above is better.






If you went for Option B in Step 3, go to https://www.deepresearchdocs.com/ and use the free tool there to create a relevant PDF. (As I mentioned above, Perplexity has an option to save Deep Research reports as PDFs, but this other tool is actually better than Perplexity's own option...). The steps to use this tool are:

(1) Copy and paste the Deep Research report from the relevant AI website into the box marked A in screenshot below.
(2) Generate the PDF by click the box marked B in the screenshot below.
(3) Download that PDF by click the box marked C in the screenshot below.  (Don't worry about the file name - I will rename any PDFs sent to me or upload to the disposable Discord group).


Section D3 : Grok 3 Deep Research

Grok 3's Deep Research is most conveniently most found within Twitter at:
https://x.com/



Anyone can use Grok to generate Deep Research reports for free (up to a daily limit).


To generate a "Deep Research" report using Grok on Twitter:

(1) Go Twitter at https://x.com/ , select "Grok" from the menu on the left, and click on the "Deep Research" button.

(2) Enter a query: Copy and paste the standard prompt from Section C, just changing the keyword to change the topic upon which a Deep Research report is to be generated.  (You can then use your computer for other tasks while the Deep Research report is generated, which usually takes a couple of minutes at present on Grok).




(3) Share the resulting report: Either 
(a) click on the "Share" button at the end of the report (i.e. the button marked "A" in the screenshot below) and then just post share a link for the resulting report on Twitter or in the disposable Discord group, OR 
(b) [ideally...] copy the report from the AI website using the copy icon at the end of the report (i.e. the button marked "B" in the screenshot below) and then paste the copy of the report into the free PDF generator at https://www.deepresearchdocs.com/, download the PDF then attach the PDF to a message in the disposable Discord group (or email it to me at isaackoi@gmail.com)





If you went for Option B in Step 3, go to https://www.deepresearchdocs.com/ and use the free tool there to create a relevant PDF. (Perplexity has an option to save Deep Research reports as PDFs, but this other tool is actually better than Perplexity's own option...). The steps to use this tool are:

(1) Copy and paste the Deep Research report from the relevant AI website into the box marked A in screenshot below.
(2) Generate the PDF by click the box marked B in the screenshot below.
(3) Download that PDF by click the box marked C in the screenshot below.  (Don't worry about the file name - I will rename any PDFs sent to me or upload to the disposable Discord group).



Section E : Potential next steps

Each of the above Deep Research tools is online. 

However, notably, open source Deep Research tools and "agentic" tools are now becoming available for installation (and modification) on your home computer, for free. 

I think that examination of the current output of general online models (and the flaws in such output), may help with the adaptation of such open source Deep Research / agentic tools for improved AI assistance with UFO research. 

 Over the last few years, I've posted about various AI tools for UFO research that I've created, including "Robert" (2018), "Jenny" (2023, April), Dave (2023, November) and "Jacques" (2024, June) and the pace of development is clearly increasing. 

A new UFO research tool, "Edoardo", should be completed soon, unless I delay its completion to add such increased functionality.

For anyone looking to play with basic AI tools online, Google's NotebookLM is a pretty easy-to-use online AI solution. NotebookLM's name is potentially misleading. It isn't some sort of notetaking app or notebook writing tool.  It can do a lot. You can upload a bunch of PDFs then generate an audio summary of them (basically a podcast with two AI presenters) OR ask questions using your voice or in writing OR generate text summaries, FAQs or written answers to specific questions.

One limitation of Notebook is that you have to upload your PDF (and there is a limit to the amount of material you can upload).  LM Studio runs on your home computer and, compared to most such options, relatively straight forward - but definitely a rung or two up the difficulty ladder compared to NotebookLM

NotebookLM's name is potentially misleading. It can do a lot. You can upload PDFs then generate an audio summary of them (basically a podcast with 2 AI presenters) OR ask questions by voice or in writing OR generate text summaries, FAQs or written answers to specific questions.

As I discussed in my item about "Jacques" (2024, June), free AI software - such as LMStudio which you can install (relatively...) easily at home has "RAG" functions incorporated which can be used to assimilate the content of  personal collections of scanned UFO files (such as PDF scans of UFO books, UFO magazines / newsletters, official UFO documents, newspaper cuttings about UFOs, UFO case files from various UFO groups, transcripts of UFO podcast / documentaries, PhD dissertations about UFOs, relevant academic journal articles and other material). 

LMStudio is basically an easy-to-install and (relatively...) easy-to-use interface for any AI/LLM models you choose to download. Those models vary from pretty small (a few GB) to absolutely huge. So, installing LMStudio itself doesn't require any advanced computer or GPU - but the problem is the size of the models you add to it.   I have previously used LMStudio with a fairly good medium-sized model (and the medium-sized model didn't exhaust either the RAM or the VRAM).  That was certainly fast enough, and good enough, to be usable.  (Online resources such as ChatGPT are smarter, but having an AI model on your computer allows easier access to PDF files and also improves privacy...). 

LMStudio is now faster and better using more recent models (e.g. distillations of Deepseek's R1 model).

Setting up LMStudio is a little bit fiddly (but doesn't require the ability to code in Python, unlike some other AI tools). 

NotebookLM is definitely a simpler experience and, in most cases (unless you want to be able to assimilate a large collection of PDFs...), probably as good as (or better), and faster than, a small or medium sized model on LMStudio.

The open source Deep Research tools can now installed at home and combined with other tools, such reasoning models (such as distillations of the Chinese DeepSeek R1 model) and 

Combining these sets of AI tools can result in fast AI consideration of personal offline resources, going beyond the general online tools referred to above. (I've previously uploaded a few million pages of UFO material and am currently seeking to address some issues which have prevented uploading further material e.g. privacy, confidentiality and permission issues).

When posted about my "Robert" UFO chatbot in 2018, I commented that it "certainly isn't that bright" but that the point was to prompt a bit of thinking about _how_ this technology could be used within ufology. Some other researchers were very kind about that initial attempt. For example, a leading European UFO researcher, Vicente-Juan Ballester-Olmos, made some very generous remarks on his Fotocat blog in March 2019. He wrote that: "In my considered opinion, what Isaac Koi has done is one of the best, most proactive and original developments in UFO research in the last decades". I similarly hope that this current item inspires some further thought about the potential use of such tools to improve the quality of research within ufology.

 



Section F : Comments from various Subject Matter Experts

Section F1 : Curt Collins on the Cash Landrum reports above

Curt Collins of Blue Blurry Lines (an expert on the Cash Landrum case) has commented:
"Interesting and disappointing. All have flaws in evaluating the quality and significance of details repeated in the source literature. Many questionable elements are stated as facts of the case, and the trivia often gets more space than key evidence. 

The ChatGPT version relies too heavily on the Wikipedia page for the case (which, though recently improved, is contaminated by factual mistakes). Rather than citing Wikipedia, I'd like it to cite the original source wherever possible. 

The Perplexity version contains "The Satellite Reentry Theory," which I've never heard before, and it seems to be a hallucination. 

The Grok version has the benefit of stating the UFO event as something the witnesses reported, not describing it as something actually occurring. 

My evaluation based on these three samples is that AI can produce a passable-looking presentation summarizing both genuine and faulty information, one that reinforces misinformation already circulating. The best thing I can say about it is that it does attempt to provide a balanced approach, mentioning negative facts about the case discovered by skeptics. Overall, AI produces a product that looks good, but would be a time-wasting nightmare for a researcher to fact-check and correct.

On a scale of 10: 
6 - ChatGPT. Points for being comprehensive but that's largely for relying too heavily on a flawed Wikipedia page. 
5 - Perplexity. Fair overview of the case, but a few hallucination. 
4 - Grok. Lacked depth, like a novice wrote it based on the first few sources located. 
4 - Human. Typical page is a summary based on previous botched summaries. Scores lower than the bots due to people generally providing one-side coverage."


at

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)