kavin/NewPipeExtractor
1
0
Fork 0
mirror of https://github.com/TeamNewPipe/NewPipeExtractor.git synced 2024-12-12 21:30:33 +05:30
Code Issues Projects Releases Wiki Activity
2,658 Commits 10 Branches 75 Tags 199 MiB
6963385176
Commit Graph

2658 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
TobiGr
6963385176 Fix issue template dir name 2024-08-02 12:50:30 +02:00
opusforlife2
5f1ba8cf7d
Add issue templates (#1204) 
* Create bug report template

* Create feature request template

* Create config.yml

---------

Co-authored-by: TobiGr <tobigr@users.noreply.github.com>
 2024-08-02 12:44:11 +02:00
Stypox
176da72cb4
Merge branch 'dev' 2024-07-25 18:29:07 +02:00
Stypox
530c157d4d
Release v0.24.2 2024-07-25 18:25:10 +02:00
Stypox
996eb046aa
Merge pull request #1203 from AudricV/yt_support-shows-and-pageheader-on-user-channels 
[YouTube] Support shows and page header on user channels
 2024-07-25 18:03:13 +02:00
AudricV
8db724943d
[YouTube] Update mocks of YoutubeChannelTabExtractorTest.Shorts test 
For some reason, mocks of the continuation were not parsed. All mocks of the
test have been updated to fix the issue.
 2024-07-25 17:51:43 +02:00
AudricV
76956ec95f
[YouTube] Fix VSauce test of YoutubeChannelExtractorTest test class 
The channel description has been changed and some expected words have been
removed.
 2024-07-25 17:51:43 +02:00
AudricV
10704dfc94
[YouTube] Fix NPE when getting channel header for videos channel tab 2024-07-25 17:51:43 +02:00
AudricV
8be64574e4
[YouTube] Support pageHeader on user channels 
Also move duplicate strings into constants and add a missing default switch
case.
 2024-07-25 17:51:42 +02:00
AudricV
df26badd4a
[YouTube] Add common methods to get ID, name and age gate object of channels 
Also move duplicate strings into constants and support pageHeader channel
header in user channels on YoutubeChannelHelper methods.
 2024-07-24 19:51:58 +02:00
AudricV
5a6da5f43e
[YouTube] Support shows in channels and provide verified status to items 
Also fix naming of info items' collection methods.
 2024-07-24 19:51:58 +02:00
AudricV
9d5201f40e
[YouTube] Add support for showRenderers in search results 2024-07-24 19:51:58 +02:00
AudricV
37178bd007
[YouTube] Add base implementation for show InfoItems 
As there are multiple show UI elements which share a lot of common data, a base
implementation, an abstract class named YoutubeBaseShowInfoItemExtractor, has
been created to handle common cases.
 2024-07-24 19:51:57 +02:00
AudricV
5879190ada
[YouTube] Move channel header's verified status code to YoutubeChannelHelper 
Also throw an exception when we cannot get the verified status of a channel in
YoutubeChannelExtractor due to a missing channelHeader, if the channel has no
channelAgeGateRenderer.
 2024-07-24 19:51:56 +02:00
AudricV
9fa8d4c0b4
[YouTube] Support playlists as URL navigation endpoints 2024-07-24 18:47:38 +02:00
AudricV
c99d94b615
[YouTube] Do not get twice runs array in YoutubeParsingHelper 
The runs object was computed twice in getTextFromObject and getUrlFromObject
methods, leading to unneeded search costs. This has been avoided by storing the
array in method variables.
 2024-07-24 18:47:30 +02:00
Stypox
2d36945b39
Merge pull request #1197 from AudricV/yt_innertube-clients-changes-for-streams 
[YouTube] Workaround HTTP 403s on streaming URLs of WEB client (after some time or instantly for some JavaScript players), update clients info
 2024-07-24 15:45:32 +02:00
AudricV
d73de6b12d
[YouTube] Don't provide streaming URLs which have an non-decoded n param 
This param used to throttle bandwidth of streaming URLs which have this
parameter when the correct value is not provided but it is not the case
anymore, as the streaming URLs return now an HTTP response code 403 in
this case.
 2024-07-23 20:48:39 +02:00
AudricV
22f818109f
[YouTube] Fix JavaScript n parameter decoding function name extraction 
This commits fixes extraction of the function name decoding the n parameter for
HTML5 clients' streaming URLs for YouTube base JavaScript player 3400486c.

Two new regexes have been added to the existing ones. All regexes and what they
extract has been documented.
 2024-07-23 20:43:56 +02:00
AudricV
480f5e223e
[YouTube] Update mocks 2024-07-23 20:43:54 +02:00
AudricV
986a76494c
[YouTube] Fix some YoutubeStreamExtractorDefaultTest tests 
- Fix typo in folder name of DescriptionTestPewdiepie test;
- Fix constant usage of DownloaderTestImpl as download implementation for
UnlistedTest and CCLicensed tests.
 2024-07-23 20:43:54 +02:00
AudricV
1c07764b4f
[YouTube] Fix YoutubeSearchExtractorTest.CrisisResources 
The "blue whale" search query does not return a crisis resource panel anymore,
so it was changed to a different word, "suicide".
 2024-07-23 20:43:54 +02:00
AudricV
a13510b962
[YouTube] Update clients info 2024-07-23 20:43:53 +02:00
AudricV
f4931d8bbd
[YouTube] Workaround 403s on streaming URLs of WEB client after some time 
These changes work around an anti-bot token, for which its requirement is A/B
tested on the WEB client. In this test, streaming URLs of this client return
HTTP errors 403 if the token is not provided after some time.

It also allows to not fetch the JavaScript player for non-age restricted
videos, reducing data usage.

The TVHTML5 embed client is now only fetched in the case of age-restricted
videos.

The methods forceFetchAndroidClient and forceFetchIosClient of
YoutubeStreamExtractor have been removed, as they are now not needed anymore.

These changes also break the extraction of appropriate error states for private
and deleted videos and invalid video IDs.
 2024-07-23 20:43:48 +02:00
Tobi
312e91048c
Merge pull request #1177 from TeamNewPipe/bandcamp-upgrade-to-https 
[Bandcamp] Upgrade incoming links to HTTPS
 2024-07-22 11:52:52 +02:00
Fynn Godau
f441036ed2 [Bandcamp] Upgrade incoming links to HTTPS 2024-07-22 11:48:02 +02:00
Marco Sirabella
02e14b8931
Add support for on.soundcloud.com urls (#1179) 
Add support for on.soundcloud.com urls

Fixes #1178

Co-authored-by: TobiGr <tobigr@users.noreply.github.com>
 2024-07-22 11:22:47 +02:00
Tobi
0e15f9ac1b
Merge pull request #1201 from TeamNewPipe/bandcamp-radio-v3 
[Bandcamp] Show additional info in radio kiosk
 2024-07-22 08:27:27 +02:00
Tobi
87af6bb223
Merge pull request #1200 from TeamNewPipe/bandcamp-fix-null-url-catenation 
[Bandcamp] Null-safe url catenation in track playlist
 2024-07-22 08:26:16 +02:00
Fynn Godau
227c6894a7 [Bandcamp] Show additional info in radio kiosk 
A newer version of the radio list API delivers additional fields. Thanks
@crisp5.
 2024-07-21 23:59:10 +02:00
Fynn Godau
97955e5e41 [Bandcamp] Null-safe url catenation in track playlist 
Previously, if no URL was provided due to the track being a preorder or
unpaid track that doesn't have its own public page, we would catenate
the artist URL and null to a nonsensical string.

This invalid URL would also be used to try fetching a thumbnail URL.

The downstream behavior of the NewPipe client is only marginally
improved, as it now no longer throws visible exceptions due to the
missing thumbnails, but still gives an unfriendly error upon clicking
the item that has a `null` URL.
 2024-07-21 23:35:57 +02:00
Tobi
4aaab63c12
Merge pull request #1199 from TeamNewPipe/bandcamp-update-artist-detection 
[Bandcamp] Update artist page detection
 2024-07-21 22:04:53 +02:00
Isira Seneviratne
9a29f9ee2d
Use the new URL encode/decode methods introduced in Java 10 (#1196) 
* Use Java 10 URLDecoder/URLEncoder methods

* Simplify compatParseMap
 2024-07-21 19:45:28 +05:30
Fynn Godau
de9fb7cb28 [Bandcamp] Update artist page detection 
Bandcamp changed the way the footer is rendered. Therefore, we check for
a link to the cart page instead.
 2024-07-21 15:37:21 +02:00
XiangRongLin
d39fc43282
[Youtube] Adjust throttling function extraction to changes (#1191) 
* [Youtube] Adjust throttling function extraction to changes

---------

Co-authored-by: Stypox <stypox@pm.me>
 2024-07-11 11:23:53 +02:00
XiangRongLin
592f1596e6
[Youtube] Adjust throttling function extraction to changes (#1191) 
* [Youtube] Adjust throttling function extraction to changes

---------

Co-authored-by: Stypox <stypox@pm.me>
 2024-07-11 11:20:33 +02:00
Tobi
c3c6de85bc
Merge pull request #1180 from TeamNewPipe/dependabot/gradle/com.google.code.gson-gson-2.11.0 
Bump com.google.code.gson:gson from 2.10.1 to 2.11.0
 2024-06-29 11:27:13 +02:00
dependabot[bot]
383000f10d
Bump com.google.code.gson:gson from 2.10.1 to 2.11.0 
Bumps [com.google.code.gson:gson](https://github.com/google/gson) from 2.10.1 to 2.11.0.
- [Release notes](https://github.com/google/gson/releases)
- [Changelog](https://github.com/google/gson/blob/main/CHANGELOG.md)
- [Commits](https://github.com/google/gson/compare/gson-parent-2.10.1...gson-parent-2.11.0)

---
updated-dependencies:
- dependency-name: com.google.code.gson:gson
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-06-29 09:22:41 +00:00
Tobi
2c7076930c
Merge pull request #1186 from TeamNewPipe/dependabot/gradle/org.junit-junit-bom-5.10.3 
Bump org.junit:junit-bom from 5.10.2 to 5.10.3
 2024-06-29 11:20:50 +02:00
dependabot[bot]
11a31721c5
Bump org.junit:junit-bom from 5.10.2 to 5.10.3 
Bumps [org.junit:junit-bom](https://github.com/junit-team/junit5) from 5.10.2 to 5.10.3.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.10.2...r5.10.3)

---
updated-dependencies:
- dependency-name: org.junit:junit-bom
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-06-28 09:50:44 +00:00
Tobi
90183056b5
Merge pull request #1183 from TeamNewPipe/dependabot/gradle/com.github.spotbugs-spotbugs-annotations-4.8.6 
Bump com.github.spotbugs:spotbugs-annotations from 4.8.5 to 4.8.6
 2024-06-22 23:35:46 +02:00
dependabot[bot]
2efea787d2
Bump com.github.spotbugs:spotbugs-annotations from 4.8.5 to 4.8.6 
Bumps [com.github.spotbugs:spotbugs-annotations](https://github.com/spotbugs/spotbugs) from 4.8.5 to 4.8.6.
- [Release notes](https://github.com/spotbugs/spotbugs/releases)
- [Changelog](https://github.com/spotbugs/spotbugs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/spotbugs/spotbugs/compare/4.8.5...4.8.6)

---
updated-dependencies:
- dependency-name: com.github.spotbugs:spotbugs-annotations
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-06-18 09:35:16 +00:00
TobiGr
fafd471606 [PeerTube] Fix test for like count 
Number changed
 2024-05-08 19:25:12 +02:00
TobiGr
4f477ad72b [PeerTube] Fix testing comment content 
The comment is not available anymore.
 2024-05-08 19:25:12 +02:00
Tobi
964e429978
Merge pull request #1166 from TeamNewPipe/dependabot/github_actions/peaceiris/actions-gh-pages-4 
Bump peaceiris/actions-gh-pages from 3 to 4
 2024-05-08 19:24:40 +02:00
dependabot[bot]
10c6965a28
Bump peaceiris/actions-gh-pages from 3 to 4 
Bumps [peaceiris/actions-gh-pages](https://github.com/peaceiris/actions-gh-pages) from 3 to 4.
- [Release notes](https://github.com/peaceiris/actions-gh-pages/releases)
- [Changelog](https://github.com/peaceiris/actions-gh-pages/blob/main/CHANGELOG.md)
- [Commits](https://github.com/peaceiris/actions-gh-pages/compare/v3...v4)

---
updated-dependencies:
- dependency-name: peaceiris/actions-gh-pages
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-05-08 17:16:08 +00:00
TobiGr
e54f38f5e7 [PeerTube] Fix test 
UploaderName was changed by user
 2024-05-08 19:13:49 +02:00
Tobi
5dd5c7a65b
Merge pull request #1173 from TeamNewPipe/dependabot/gradle/com.github.spotbugs-spotbugs-annotations-4.8.5 
Bump com.github.spotbugs:spotbugs-annotations from 4.8.3 to 4.8.5
 2024-05-08 19:12:40 +02:00
Tobi
37438ff82f
Merge pull request #1174 from TeamNewPipe/dependabot/gradle/org.mozilla-rhino-1.7.15 
Bump org.mozilla:rhino from 1.7.13 to 1.7.15
 2024-05-08 19:02:57 +02:00
TobiGr
bba3b6c69b version 0.24.0 2024-05-08 13:01:06 +02:00