react-snap sometimes only crawls a single page
Deployment of react-snap on a CRA app has been mostly painless, giving huge page load speed boosts and requiring zero specialized configuration.
However, I'm seeing occasional issues with deploys (both locally and from netlify) only crawling a single page and then appearing done. Like this:
Normal result (maybe 50% of the time) means crawling ~50 pages and then everything else successfully finishes.
I've tried limiting concurrency to 1 without improvement. What other tools can I use to figure this problem out or configuration options can I include to fix this?
Figured this out: Webpack was setting PUBLIC_URL to the production domain, and new deploys were looking on that domain for a JS file that looked like main.1234abcd.js, using a hash of the js file for cache busting. This didn't exist on the production domain before it was deployed so loading the page failed and no links were detected.
Setting the JS links to root-relative URL (i.e. /static/js/main.1234abcd.js) loaded the JS correctly from the snap-created server and allowed it to be crawled correctly.
In addition, it was helpful to debug via the anchor crawling section in react-snap here: https://github.com/stereobooster/react-snap/blob/master/src/puppeteer_utils.js#L108-L119
- React map using Objects.entries for rendering inputs dynamically and change values of individual fields
- ServiceWorker Update loop - Create react app
- Mantine Form TextInput won't maintain focus when input is wrapped in another component
- Displaying pure JSON format with black background in GraphQL Express React
- Canceling a react-query mutation
- Creating a Custom Button in React Typescript and add onClick Event
- Argument of type x is not assignable to parameter of type 'ForwardRefRenderFunction<unknown, PropsWithoutRef<P>>'
- fetch data with sort not updating after build
- Can you destructure a result from an SWR query?
- Flask Api working Half the time- works flawlessly when sending post with python but not with javascript
- react-native-chart-kit Min and Max value
- Preserve Exit Animations with React Router v6 and Framer Motion
- How do I load a remote script (widget) inside a react component
- How to make series of images to slide uniformly and horizontally with using JavaScript to change transform transition
- TS2503: Cannot find namespace 'JSX'. - What is equivalent of `JSX.IntrinsicElements`?
- Any way to render HTML in react-markdown
- Problem with rendering markdown in NextJS/React
- Change Gatsby Link Behaviour - Stop Scroll Animation on Page Change
- How can i convert a big gltf file to jsx?
- Can we have a portal in Next.js
- NextAuth: how to return custom errors without redirection
- Why is React useState with functional update form is needed?
- Use localStorage.getItem() with typescript
- How to change active tab color in Material UI?
- Electron React 404 not found in production
- Adding Tanstack react-query to laravel 11 reactjs inertia project
- How to call loading function with React useEffect only once
- Getting Uncaught Error: Minified React error #418 on my Gatsby production build
- Autodesk viewer error TypeError: Cannot read properties of null (reading 'updateMaterials')
- How to make search in select box using React JS?