从具有特定模式的文本中获取tsv

如何解决从具有特定模式的文本中获取tsv

我是生物学家,我需要在一个文本文件中获取信息 我有一个像这样的纯文本文件:

12018411
Comparison of two timed artificial insemination (TAI) protocols for management of first insemination postpartum. 
  TAI|timed artificial insemination|0.999808
Two estrus-synchronization programs were compared and factors influencing their success over a year were evaluated. All cows received a setup injection of PGF2alpha at 39 +/- 3 d postpartum. Fourteen days later they received GnRH,followed in 7 d by a second injection of PGF2alpha. Cows (n = 523) assigned to treatment 1 (modified targeted breeding) were inseminated based on visual signs of estrus at 24,48,or 72 h after the second PGF2alpha injection. Any cow not observed in estrus was inseminated at 72 h. Cows (n = 440) assigned to treatment 2 received a second GnRH injection 48 h after the second PGF2alpha,and all were inseminated 24 h later. Treatment,season of calving,multiple birth,estrual status at insemination,number of occurrences of estrus before second PGF2alpha,prophylactic use of PGF2alpha,retained fetal membranes,and occurrence of estrus following the setup PGF2alpha influenced success. Conception rate was 31.2% (treatment 1) and 29.1% (treatment 2). A significant interaction occurred between protocol and estrual status at insemination. Cows in estrus at insemination had a 45.8% (treatment 1) or 35.4% (treatment 2) conception rate. The conception rate for cows not expressing estrus at insemination was 19.2% (treatment 1) and 27.7% (treatment 2). Provided good estrous detection exists,modified targeted breeding can be as successful as other timed artificial insemination programs. Nutritional,environmental,and management strategies to reduce postpartum disorders and to minimize the duration of postpartum anestrus are critical if synchronization schemes are used to program first insemination after the voluntary waiting period. 
    
8406022
Deletion of the beta-turn/alpha-helix motif at the exon 2/3 boundary of human c-Myc leads to the loss of its immortalizing function. 
The protein product (c-Myc) of the human c-myc proto-oncogene carries a beta-turn/alpha-helix motif at the exon2/exon3 boundary. The amino acid (aa) sequence and secondary structure of this motif are highly conserved among several nuclearly localized oncogene products,c-Myc,N-Myc,c-Fos,SV40 large T and adenovirus (Ad) Ela. Removal of this region from Ad E1a results in the loss of the transforming properties of the virus without destroying its known transregulatory functions. In order to analyse whether deletion of the above-mentioned region from c-Myc has a similar effect on its transformation activity,we constructed a deletion mutant (c-myc delta) lacking the respective aa at the exon2/exon3 boundary. In contrast to the c-myc wild-type gene product,constitutive expression of c-myc delta does not lead to the immortalization of primary mouse embryo fibroblast cells (MEF cells). This result indicates that c-Myc and Ad El a share a common domain which is involved in the transformation process by both oncogenes. 
  aa|amino acid|0.99818
  Ad|adenovirus|0.96935
  MEF cells|mouse embryo fibroblast cells|0.994648

第一行是id,第二行是标题,第三行是摘要(有时有缩写),最后一行(如果有)是带双倍空格的缩写,缩写是含义和数字。您可以看到:

  GA|general anesthesia|0.99818

然后在空白处有一行,然后重新开始:ID,标题,摘要,缩写或ID,标题,缩写,摘要。 我需要获取这些数据并将其转换为这样的TSV文件:

12018411  TAI  timed artificial insemination
8406022   aa   amino acids
8406022   Ad   adenovirus
...      ...    ...

第一列ID,第二列缩写和第三列此缩写的含义。 我尝试先在Dataframe中进行转换,然后再转换为TSV,但是我不知道如何利用所需的结构获取文本信息。 我也尝试使用此代码:

from collections import namedtuple
import pandas as pd

Item= namedtuple('Item','ID')
items = []

with open("identify_abbr-out.txt","r",encoding='UTF-8') as f:
    lines= f.readlines()
    for line in lines:
        if line== '\n':
            ID= ¿nextline?
        if line.startswith("  "):
            Abbreviation = line
            items.append(Item(ID,Abbreviation))

df = pd.DataFrame.from_records(items,columns=['ID','Abbreviation'])

但是我不知道如何读取下一行,也找不到代码,因为有时在语料库和标题之间的中间有一些空白行。

我正在使用python 3.8

非常感谢您。

解决方法

假设test.txt拥有您的输入数据,我使用了简单的文件读取功能来处理数据-

file1 = open('test.txt','r') 
Lines = file1.readlines() 
outputlines = []
outputline=""
counter = 0
for l in Lines:
    if l.strip()=="":
        outputline = ""
        counter = 0
    elif counter==0:
        outputline = outputline + l.strip() + "|"
        counter = counter + 1
    elif counter==1:
        counter = counter + 1
    else:
        if len(l.split("|"))==3 and l[0:2]=="  " :
            outputlines.append(outputline + l.strip() +"\n")
        counter = counter + 1
        
file1 = open('myfile.txt','w') 
file1.writelines(outputlines) 
file1.close() 

逐行读取文件,保留计数器,并在出现空白行时重置计数器,并在下一行读取ID。如果有3个字段“ |”分隔的行,开头有两个空格,行以ID导出

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。

相关推荐


依赖报错 idea导入项目后依赖报错,解决方案:https://blog.csdn.net/weixin_42420249/article/details/81191861 依赖版本报错:更换其他版本 无法下载依赖可参考:https://blog.csdn.net/weixin_42628809/a
错误1:代码生成器依赖和mybatis依赖冲突 启动项目时报错如下 2021-12-03 13:33:33.927 ERROR 7228 [ main] o.s.b.d.LoggingFailureAnalysisReporter : *************************** APPL
错误1:gradle项目控制台输出为乱码 # 解决方案:https://blog.csdn.net/weixin_43501566/article/details/112482302 # 在gradle-wrapper.properties 添加以下内容 org.gradle.jvmargs=-Df
错误还原:在查询的过程中,传入的workType为0时,该条件不起作用 <select id="xxx"> SELECT di.id, di.name, di.work_type, di.updated... <where> <if test=&qu
报错如下,gcc版本太低 ^ server.c:5346:31: 错误:‘struct redisServer’没有名为‘server_cpulist’的成员 redisSetCpuAffinity(server.server_cpulist); ^ server.c: 在函数‘hasActiveC
解决方案1 1、改项目中.idea/workspace.xml配置文件,增加dynamic.classpath参数 2、搜索PropertiesComponent,添加如下 <property name="dynamic.classpath" value="tru
删除根组件app.vue中的默认代码后报错:Module Error (from ./node_modules/eslint-loader/index.js): 解决方案:关闭ESlint代码检测,在项目根目录创建vue.config.js,在文件中添加 module.exports = { lin
查看spark默认的python版本 [root@master day27]# pyspark /home/software/spark-2.3.4-bin-hadoop2.7/conf/spark-env.sh: line 2: /usr/local/hadoop/bin/hadoop: No s
使用本地python环境可以成功执行 import pandas as pd import matplotlib.pyplot as plt # 设置字体 plt.rcParams['font.sans-serif'] = ['SimHei'] # 能正确显示负号 p
错误1:Request method ‘DELETE‘ not supported 错误还原:controller层有一个接口,访问该接口时报错:Request method ‘DELETE‘ not supported 错误原因:没有接收到前端传入的参数,修改为如下 参考 错误2:cannot r
错误1:启动docker镜像时报错:Error response from daemon: driver failed programming external connectivity on endpoint quirky_allen 解决方法:重启docker -> systemctl r
错误1:private field ‘xxx‘ is never assigned 按Altʾnter快捷键,选择第2项 参考:https://blog.csdn.net/shi_hong_fei_hei/article/details/88814070 错误2:启动时报错,不能找到主启动类 #
报错如下,通过源不能下载,最后警告pip需升级版本 Requirement already satisfied: pip in c:\users\ychen\appdata\local\programs\python\python310\lib\site-packages (22.0.4) Coll
错误1:maven打包报错 错误还原:使用maven打包项目时报错如下 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-resources-plugin:3.2.0:resources (default-resources)
错误1:服务调用时报错 服务消费者模块assess通过openFeign调用服务提供者模块hires 如下为服务提供者模块hires的控制层接口 @RestController @RequestMapping("/hires") public class FeignControl
错误1:运行项目后报如下错误 解决方案 报错2:Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project sb 解决方案:在pom.
参考 错误原因 过滤器或拦截器在生效时,redisTemplate还没有注入 解决方案:在注入容器时就生效 @Component //项目运行时就注入Spring容器 public class RedisBean { @Resource private RedisTemplate<String
使用vite构建项目报错 C:\Users\ychen\work>npm init @vitejs/app @vitejs/create-app is deprecated, use npm init vite instead C:\Users\ychen\AppData\Local\npm-