Skip to content

Fix blank line skipping in read_fwf, issue 22693 #22849

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 8 commits into from

Conversation

xiejxie
Copy link

@xiejxie xiejxie commented Sep 27, 2018

Fixes the bug where blank lines are not skipped using read_fwf even when skip_blank_lines is set to true. Override default behaviour in FixedWidthFieldParser.

@pep8speaks
Copy link

pep8speaks commented Sep 27, 2018

Hello @xiejxie! Thanks for updating the PR.

Comment last updated on September 27, 2018 at 01:11 Hours UTC

@codecov
Copy link

codecov bot commented Sep 28, 2018

Codecov Report

Merging #22849 into master will increase coverage by <.01%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #22849      +/-   ##
==========================================
+ Coverage   92.19%   92.19%   +<.01%     
==========================================
  Files         169      169              
  Lines       50827    50835       +8     
==========================================
+ Hits        46860    46868       +8     
  Misses       3967     3967
Flag Coverage Δ
#multiple 90.61% <100%> (ø) ⬆️
#single 42.36% <12.5%> (-0.01%) ⬇️
Impacted Files Coverage Δ
pandas/io/parsers.py 95.62% <100%> (+0.02%) ⬆️
pandas/core/frame.py 97.2% <0%> (ø) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d115900...df95b71. Read the comment docs.

@jreback
Copy link
Contributor

jreback commented Nov 23, 2018

closing as stale. if you'd like to continue, pls ping.

@jreback jreback closed this Nov 23, 2018
@dvalters
Copy link

dvalters commented Jul 11, 2019

Hi @jreback, just wondering if we could pick this up and continue the work of @xiejxie here? Seems like we are on track towards a fix, just need a bit more iteration. (Also I think the current test might result in a false positive, as read_csv is also affected by the bug?)

@WillAyd
Copy link
Member

WillAyd commented Jul 11, 2019

@dwalters feel free to open a new PR

@TianyiPeng
Copy link

Hi @jreback, just wondering if we could pick this up and continue the work of @xiejxie here? Seems like we are on track towards a fix, just need a bit more iteration. (Also I think the current test might result in a false positive, as read_csv is also affected by the bug?)

@dvalters I would like to help but not sure how to do it. Any intuition on how to fix the read_csv bug?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

read_fwf: skip_blank_lines does nothing
6 participants