Skip to content

Commit f4004f6

Browse files
authored
Merge pull request #374 from kulikalov/update-dependencies
### Changed - Update [jquery](https://github.com/jquery/jquery) version to 3.5.1. - Update [lodash](https://lodash.com) version to 4.17.20. - Update [puppeteer](https://github.com/puppeteer/puppeteer) version to 1.20.0. - Update [request](https://github.com/request/request) version to 2.88.2. - Update [request-promise](https://github.com/request/request-promise) version to 4.2.6. - Update [@types/lodash](https://github.com/DefinitelyTyped/DefinitelyTyped) version to 4.14.162. - Update [@types/puppeteer](https://github.com/DefinitelyTyped/DefinitelyTyped) version to 1.20.0. - Update [@types/request-promise](https://github.com/DefinitelyTyped/DefinitelyTyped) version to 4.1.46. ### Fixed - Fix `crawler.response` returning `null` when connecting to specific chrome instance (Closes #354). - Fix crawler failure to follow urls with `#` hashes in them (Closes #332). - Fix crawler pending indefinitely when mixed content is present (Closes #260). ### Security - Fix: 🔒 high-severity lodash vulnerability (Closes #339). - Fix: 🔒 update jquery and lodash to fix Prototype Pollution vulnerability. - Fix: 🔒 update puppeteer to fix Use After Free vulnerability (Closes #350). - Fix: 🔒 update JQuery to fix XSS vulnerability
2 parents ad95c2c + d2d9117 commit f4004f6

File tree

3 files changed

+229
-60
lines changed

3 files changed

+229
-60
lines changed

docs/CHANGELOG.md

Lines changed: 36 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,30 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
77

88
## [Unreleased]
99

10+
### Changed
11+
12+
- Update [jquery](https://github.com/jquery/jquery) version to 3.5.1.
13+
- Update [lodash](https://lodash.com) version to 4.17.20.
14+
- Update [puppeteer](https://github.com/puppeteer/puppeteer) version to 1.20.0.
15+
- Update [request](https://github.com/request/request) version to 2.88.2.
16+
- Update [request-promise](https://github.com/request/request-promise) version to 4.2.6.
17+
- Update [@types/lodash](https://github.com/DefinitelyTyped/DefinitelyTyped) version to 4.14.162.
18+
- Update [@types/puppeteer](https://github.com/DefinitelyTyped/DefinitelyTyped) version to 1.20.0.
19+
- Update [@types/request-promise](https://github.com/DefinitelyTyped/DefinitelyTyped) version to 4.1.46.
20+
21+
### Fixed
22+
23+
- Fix `crawler.response` returning `null` when connecting to specific chrome instance #354.
24+
- Fix crawler failure to follow urls with `#` hashes in them #332.
25+
- Fix crawler pending indefinitely when mixed content is present #260.
26+
27+
### Security
28+
29+
- Fix: 🔒 high-severity lodash vulnerability #339.
30+
- Fix: 🔒 update jquery and lodash to fix Prototype Pollution vulnerability.
31+
- Fix: 🔒 update puppeteer to fix Use After Free vulnerability #350.
32+
- Fix: 🔒 update JQuery to fix XSS vulnerability
33+
1034
## [1.8.0] - 2018-06-11
1135

1236
### Added
@@ -90,7 +114,7 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
90114

91115
### Changed
92116

93-
- Allow `allowedDomains` option to accept a list of regular expressions.
117+
- Allow `allowedDomains` option to accept a list of regular expressions.
94118

95119
## [1.3.2] - 2018-01-19
96120

@@ -110,6 +134,7 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
110134
- Fix a bug of not obeying robots.txt.
111135

112136
## [1.3.0] - 2018-01-12
137+
113138
### Added
114139

115140
- Add [HCCrawler.defaultArgs()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#hccrawlerdefaultargs) method.
@@ -121,6 +146,7 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
121146
- Moved `onSuccess`, `onError` and `maxDepth` options from [HCCrawler.connect()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#hccrawlerconnectoptions) and [HCCrawler.launch()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#hccrawlerlaunchoptions) to [crawler.queue()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#crawlerqueueoptions).
122147

123148
## [1.2.5] - 2018-01-03
149+
124150
### Added
125151

126152
- Support `obeyRobotsTxt` for [crawler.queue()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#crawlerqueueoptions)'s options.
@@ -133,6 +159,7 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
133159
- Modify `BaseCache` interface.
134160

135161
## [1.2.4] - 2017-12-25
162+
136163
### Added
137164

138165
- Support [CSV](https://tools.ietf.org/html/rfc4180) and [JSON Lines](http://jsonlines.org) formats for exporting results
@@ -149,6 +176,7 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
149176
- Fix a bug of ignoring maxDepth option.
150177

151178
## [1.2.3] - 2017-12-17
179+
152180
### Changed
153181

154182
- Refactor by changing tye style of requiring cache directory.
@@ -158,22 +186,26 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
158186
- Fix a bug of starting too many crawlers more than maxConcurrency when requests fail.
159187

160188
## [1.2.2] - 2017-12-16
189+
161190
### Added
162191

163192
- Automatically collect and follow links found in the requested page.
164193
- Support `maxDepth` for [crawler.queue()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#crawlerqueueoptions)'s options.
165194

166195
## [1.2.1] - 2017-12-13
196+
167197
### Added
168198

169199
- Support `screenshot` for [crawler.queue()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#crawlerqueueoptions)'s options.
170200

171201
## [1.2.0] - 2017-12-11
202+
172203
### Changed
173204

174205
- Rename `ensureCacheClear` to `persistCache` for [HCCrawler.connect()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#hccrawlerconnectoptions) and [HCCrawler.launch()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#hccrawlerlaunchoptions)'s options.
175206

176207
## [1.1.2] - 2017-12-10
208+
177209
### Added
178210

179211
- Support `maxRequest` for [HCCrawler.connect()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#hccrawlerconnectoptions) and [HCCrawler.launch()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#hccrawlerlaunchoptions)'s options.
@@ -183,6 +215,7 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
183215
- Add [crawler.pendingQueueSize](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#crawlerpendingqueuesize) and [crawler.requestedCount](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#crawlerrequestedcount) read-only properties.
184216

185217
## [1.1.1] - 2017-12-09
218+
186219
### Added
187220

188221
- Add [CHANGELOG.md](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/CHANGELOG.md) based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
@@ -194,6 +227,7 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
194227
- Performance improvement by setting a page parallel.
195228

196229
## [1.1.0] - 2017-12-08
230+
197231
### Added
198232

199233
- Support `extraHeaders` for [crawler.queue()](https://github.com/yujiosaka/headless-chrome-crawler/blob/master/docs/API.md#crawlerqueueoptions)'s options.
@@ -207,6 +241,7 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
207241
- Refactor handlers for options.
208242

209243
## [1.0.0] - 2017-12-05
244+
210245
### Added
211246

212247
- Add test with [mocha](https://mochajs.org) and [power-assert](https://github.com/power-assert-js/power-assert).

package.json

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -26,11 +26,11 @@
2626
"homepage": "https://github.com/yujiosaka/headless-chrome-crawler#readme",
2727
"dependencies": {
2828
"debug": "3.1.0",
29-
"jquery": "3.3.1",
30-
"lodash": "4.17.5",
31-
"puppeteer": "1.5.0",
32-
"request": "2.87.0",
33-
"request-promise": "4.2.2",
29+
"jquery": "3.5.1",
30+
"lodash": "4.17.20",
31+
"puppeteer": "1.20.0",
32+
"request": "2.88.2",
33+
"request-promise": "4.2.6",
3434
"robots-parser": "1.0.2"
3535
},
3636
"peerDependencies": {
@@ -40,10 +40,10 @@
4040
"@commitlint/cli": "7.0.0",
4141
"@commitlint/config-conventional": "7.0.0",
4242
"@types/debug": "0.0.30",
43-
"@types/lodash": "4.14.110",
43+
"@types/lodash": "4.14.162",
4444
"@types/node": "10.3.4",
45-
"@types/puppeteer": "1.3.4",
46-
"@types/request-promise": "4.1.41",
45+
"@types/puppeteer": "1.20.0",
46+
"@types/request-promise": "4.1.46",
4747
"eslint": "5.0.1",
4848
"eslint-config-airbnb": "17.0.0",
4949
"eslint-plugin-import": "2.13.0",

0 commit comments

Comments
 (0)