vmarkovtsev/github_markdown_headers_disaster.md

Last active January 1, 2018 16:53

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/vmarkovtsev/59cd7349d41cf804b9a8775388e681f8.js"></script>
Save vmarkovtsev/59cd7349d41cf804b9a8775388e681f8 to your computer and use it in GitHub Desktop.

Download ZIP

Raw

github_markdown_headers_disaster.md

Recently, GitHub introduced the change in how atx headers are parsed in Markdown files.

##Wrong

Correct

While this change follows the spec, it breaks many existing repositories. I took the README dataset which we created at source{d} and ran a simple regexp PySpark job. It appeared that more than 500,000 repositories have README files which are rendered with invalid headers.

Among those 0.5mm, there are more than 10,000 which have more than 50 stars. They were uploaded to data.world.