栏中的多个日期:R

如何解决栏中的多个日期:R

好的,我经历了几个问题,我认为我的数据中有一个可以解决的模式(也就是说,我可以区分dmy和mdy)。

让我为数据集提供一些背景知识。数据集包含有关当前隔离期间出行人员的信息。因此,当我向下滚动数据集时,我看到大多数日期是以M-D-Y格式输入的,而有些则是以dmy格式输入的。

因此对于此数据集,(数据集包含截至八月的信息)。歧义可以通过以下方式解决:

  1. 日期不能在将来。因此,这解决了08-12-2020和12-08-2020之间的差异。而且,我只有直到六月的数据。
  2. 日子比几个月快。如果我看到一个序列(无论是dmy还是mdy),如果我看到每隔几行就有一个数字变化(比如说20),那么我知道变化的数字是一天而不是一个月。 示例:

Changing numbers in a date

在这种情况下如何正确分配日期?

解决方法

因此,如果我理解正确,则您的数据按时间顺序排列,并且您对测量数据的时间范围有所了解。

有鉴于此,这是我创建加扰数据然后重新解析它的目的:

library(dplyr)
library(lubridate)
library(zoo) # for na.locf function

# create some scrambled data to work with
df <- tibble(
    date_ground_truth = rep(seq(from = ymd('20190801'),to = ymd('20200730'),by = 1),each = 5)
  ) %>%
  mutate(
    date_inconsistent_chr = format(date_ground_truth,ifelse(runif(nrow(.),1) > 0.3,'%Y/%m/%d','%Y/%d/%m'))
  )

# providing here the date range in which your observations lie. I only know that it maxes end of July 2020,so my end result has some remaining unknowns at the start
daterange_known_min <- NA_Date_
daterange_known_max <- ymd('20200730')

# initiate a cleaned df - for any date where we have a day > 12,we know that it can only be one format of YMD/YDM
df_recleaned <- df %>%
  mutate(
    date_parsed_ymd = as.Date(date_inconsistent_chr,'%Y/%m/%d'),# try YMD
    date_parsed_ydm = as.Date(date_inconsistent_chr,'%Y/%d/%m'),# try YDM
    
    date_parsed_deducted = case_when( # write out the clear cut cases
      day(date_parsed_ymd) > 12 ~ date_parsed_ymd,day(date_parsed_ydm) > 12 ~ date_parsed_ydm,date_parsed_ymd == date_parsed_ydm ~ date_parsed_ymd,T ~ NA_Date_
    )
  )

# we will run over the data until we can not deduct any more new dates from what we've learnt so far:

new_guesses_possible <- T
while(new_guesses_possible) {
  # how many dates did we already deduct?
  num_deducted_dates_before <- df_recleaned %>% filter(!is.na(date_parsed_deducted)) %>% nrow()
  
  # deduct more,based on our knowledge that the dates are chronological and within a certain time-frame
  df_recleaned <- df_recleaned %>%
    mutate(
      earliest_possible_date = coalesce(na.locf(date_parsed_deducted,na.rm = F),daterange_known_min),last_possible_date = coalesce(na.locf(date_parsed_deducted,fromLast = T,daterange_known_max),ymd_guess_in_range = coalesce(date_parsed_ymd >= earliest_possible_date & date_parsed_ymd <= last_possible_date,F),ydm_guess_in_range = coalesce(date_parsed_ydm >= earliest_possible_date & date_parsed_ydm <= last_possible_date,date_parsed_deducted = case_when(
        # keep clear cases
        !is.na(date_parsed_deducted) ~ date_parsed_deducted,# if the ymd-guess falls between the last clear case and next clear case,take ymd
        ymd_guess_in_range & !ydm_guess_in_range ~ date_parsed_ymd,# same approach for ydm
        ydm_guess_in_range & !ymd_guess_in_range ~ date_parsed_ydm,# cover the cases where we don't know either the last or next clear parsed date
        # if one of the parsed dates falls before the "first possible date",take the other one.
        #   (if no daterange_known_min is given,these rows will result in NA and not do anything...)
        date_parsed_ymd < daterange_known_min ~ date_parsed_ydm,date_parsed_ydm < daterange_known_min ~ date_parsed_ymd,# inversely,if one parsed option falls after the "last possible date",ignore it.
        date_parsed_ymd > daterange_known_max ~ date_parsed_ydm,date_parsed_ydm > daterange_known_max ~ date_parsed_ymd
      )
    )
  
  # how many dates did we now deduct?
  num_deducted_dates_after <- df_recleaned %>% filter(!is.na(date_parsed_deducted)) %>% nrow()
  
  # do we need to go on?
  new_guesses_possible <- num_deducted_dates_after > 0 & num_deducted_dates_before != num_deducted_dates_after
}

# kick out all those extra columns :)
df_recleaned_final <- df_recleaned %>%
  select(
    -date_parsed_ymd,-date_parsed_ydm,-earliest_possible_date,-last_possible_date,-ymd_guess_in_range,-ydm_guess_in_range
  )

在我的示例中,这修复了2019年8月第一周之后的所有日期。
如果数据之间的间隔更长,它可能会给您带来不同的结果。

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。

相关推荐


依赖报错 idea导入项目后依赖报错,解决方案:https://blog.csdn.net/weixin_42420249/article/details/81191861 依赖版本报错:更换其他版本 无法下载依赖可参考:https://blog.csdn.net/weixin_42628809/a
错误1:代码生成器依赖和mybatis依赖冲突 启动项目时报错如下 2021-12-03 13:33:33.927 ERROR 7228 [ main] o.s.b.d.LoggingFailureAnalysisReporter : *************************** APPL
错误1:gradle项目控制台输出为乱码 # 解决方案:https://blog.csdn.net/weixin_43501566/article/details/112482302 # 在gradle-wrapper.properties 添加以下内容 org.gradle.jvmargs=-Df
错误还原:在查询的过程中,传入的workType为0时,该条件不起作用 &lt;select id=&quot;xxx&quot;&gt; SELECT di.id, di.name, di.work_type, di.updated... &lt;where&gt; &lt;if test=&qu
报错如下,gcc版本太低 ^ server.c:5346:31: 错误:‘struct redisServer’没有名为‘server_cpulist’的成员 redisSetCpuAffinity(server.server_cpulist); ^ server.c: 在函数‘hasActiveC
解决方案1 1、改项目中.idea/workspace.xml配置文件,增加dynamic.classpath参数 2、搜索PropertiesComponent,添加如下 &lt;property name=&quot;dynamic.classpath&quot; value=&quot;tru
删除根组件app.vue中的默认代码后报错:Module Error (from ./node_modules/eslint-loader/index.js): 解决方案:关闭ESlint代码检测,在项目根目录创建vue.config.js,在文件中添加 module.exports = { lin
查看spark默认的python版本 [root@master day27]# pyspark /home/software/spark-2.3.4-bin-hadoop2.7/conf/spark-env.sh: line 2: /usr/local/hadoop/bin/hadoop: No s
使用本地python环境可以成功执行 import pandas as pd import matplotlib.pyplot as plt # 设置字体 plt.rcParams[&#39;font.sans-serif&#39;] = [&#39;SimHei&#39;] # 能正确显示负号 p
错误1:Request method ‘DELETE‘ not supported 错误还原:controller层有一个接口,访问该接口时报错:Request method ‘DELETE‘ not supported 错误原因:没有接收到前端传入的参数,修改为如下 参考 错误2:cannot r
错误1:启动docker镜像时报错:Error response from daemon: driver failed programming external connectivity on endpoint quirky_allen 解决方法:重启docker -&gt; systemctl r
错误1:private field ‘xxx‘ is never assigned 按Altʾnter快捷键,选择第2项 参考:https://blog.csdn.net/shi_hong_fei_hei/article/details/88814070 错误2:启动时报错,不能找到主启动类 #
报错如下,通过源不能下载,最后警告pip需升级版本 Requirement already satisfied: pip in c:\users\ychen\appdata\local\programs\python\python310\lib\site-packages (22.0.4) Coll
错误1:maven打包报错 错误还原:使用maven打包项目时报错如下 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-resources-plugin:3.2.0:resources (default-resources)
错误1:服务调用时报错 服务消费者模块assess通过openFeign调用服务提供者模块hires 如下为服务提供者模块hires的控制层接口 @RestController @RequestMapping(&quot;/hires&quot;) public class FeignControl
错误1:运行项目后报如下错误 解决方案 报错2:Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project sb 解决方案:在pom.
参考 错误原因 过滤器或拦截器在生效时,redisTemplate还没有注入 解决方案:在注入容器时就生效 @Component //项目运行时就注入Spring容器 public class RedisBean { @Resource private RedisTemplate&lt;String
使用vite构建项目报错 C:\Users\ychen\work&gt;npm init @vitejs/app @vitejs/create-app is deprecated, use npm init vite instead C:\Users\ychen\AppData\Local\npm-