feat: pagesix parser

[janetleekim]

Tests are passing but no image appeared on the preview. Not sure if
that’s an issue.

[kev5873]

Same issue as the other PR where I'd like @adampash to verify.

[adampash]

Somehow I missed this. What did you want me to verify, @kev5873?

[kev5873]

It also appears that nypost.com has a very similar layout, and appears to be compatible with this one, since they are in the same network of sites.

[adampash]

Nice. 👍

[adampash]

A few small optimizations.

[adampash]

Nice. 👍

[adampash]

Here's how I'd re-write the content extractor:

  content: {
    selectors: [
      ['#featured-image-wrapper', '.entry-content'],
      '.entry-content',
    ],

    // Is there anything in the content you selected that needs transformed
    // before it's consumable content? E.g., unusual lazy loaded images
    transforms: {
      '#featured-image-wrapper': 'figure',
      '.wp-caption-text': 'figcaption',
    },

    // Is there anything that is in the result that shouldn't be?
    // The clean selectors will remove anything that matches from
    // the result
    clean: [
      '.modal-trigger',
    ],
  },

So, bit by bit:

    selectors: [
      ['#featured-image-wrapper', '.entry-content'],
      '.entry-content',
    ],

First, by focusing on .entry-content instead of .article-header, you don't have to clean near as much from the page (see the much smaller clean section). You can still get the lead image by doing a multi-element selector for the content — this says get the #featured-image-wrapper, then get the .entry-content, and put them together.

    transforms: {
      '#featured-image-wrapper': 'figure',
      '.wp-caption-text': 'figcaption',
    },

This transform just changes div#featured-image-wrapper to a figure, which will then work correctly — and then we can also easily transform div.wp-caption-text into a figcaption.

[dviramontes]

lgtm!