Look into why some "real" titles are not matching up in the deduplication process

[katnquinn]

There's been an issue with a couple different article pulls where "real" titles (many words, not just "Introduction" or something) are not always matching up:

WITH merged_pubs AS(SELECT DISTINCT merged_id, title_english FROM `gcp-cset-projects.dod_research.pubdefense` 
INNER JOIN `literature.papers` ON LOWER(title_english) = LOWER(title))

SELECT COUNT(DISTINCT merged_id) as paper_count, title_english FROM merged_pubs
WHERE merged_id NOT IN(SELECT merged_id FROM merged_pubs WHERE REGEXP_CONTAINS(title_english, r"(?i)((invited commentary)|(book chapter)|(review essay)|(article index)|(From the Archives)|(book review)|(From the Editor in Chief)|(off the press))") OR LOWER(title_english) = "introduction") AND LENGTH(title_english) - LENGTH(REPLACE(title_english," ",'')) > 5
GROUP BY title_english
ORDER BY paper_count DESC

In many cases, there appears to be nearly all null fields and then the DOI is off by a couple of digits in the suffix (like for "Molecular Features of Cephalosporins Important for Activity against Antimicrobial-Resistant Neisseria gonorrhoeae" where the dois are all nearly identical doi except for a .sXXX at the end)

doi
10.1021/acsinfecdis.0c00400.s001
10.1021/acsinfecdis.0c00400.s002
10.1021/acsinfecdis.0c00400.s003
10.1021/acsinfecdis.0c00400.s004
10.1021/acsinfecdis.0c00400.s005
10.1021/acsinfecdis.0c00400.s006
10.1021/acsinfecdis.0c00400.s007
10.1021/acsinfecdis.0c00400.s008
10.1021/acsinfecdis.0c00400.s009
10.1021/acsinfecdis.0c00400.s010
10.1021/acsinfecdis.0c00400.s011
10.1021/acsinfecdis.0c00400.s012
10.1021/acsinfecdis.0c00400.s013
10.1021/acsinfecdis.0c00400.s014
10.1021/acsinfecdis.0c00400.s015
10.1021/acsinfecdis.0c00400.s016
10.1021/acsinfecdis.0c00400.s017
10.1021/acsinfecdis.0c00400.s018
10.1021/acsinfecdis.0c00400.s019
10.1021/acsinfecdis.0c00400.s020
10.1021/acsinfecdis.0c00400.s021
10.1021/acsinfecdis.0c00400.s022
10.1021/acsinfecdis.0c00400.s023
10.1021/acsinfecdis.0c00400.s024
10.1021/acsinfecdis.0c00400.s025
10.1021/acsinfecdis.0c00400.s026
10.1021/acsinfecdis.0c00400.s027