2106 Commits

Author SHA1 Message Date
AudricV
1df0267440
[YouTube] Make client and origin HTTP headers methods package-private
This allows their internal usage in an upcoming new class to be used on
other InnerTube clients than the WEB one.
2025-02-05 09:56:52 +01:00
AudricV
3691fc22c6
[YouTube] Add an interface and a class to fetch and provide poTokens 2025-02-05 09:56:52 +01:00
AudricV
fd82ec585b
[YouTube] Move to their own file and update clients' constants
Also update client version and device info and add TVHTML5 client and
WEB_EMBEDDED_PLAYER constants, these will be used in the future.

TVHTML5_SIMPLY_EMBED_CLIENT_VERSION has been kept in its place as
the corresponding client does not work anonymously anymore, so it will
be removed soon.
2025-02-05 09:56:52 +01:00
AudricV
a336a8ca97
[Soundcloud] Update SoundcloudStreamExtractorTest with latest changes 2025-01-28 21:52:29 +01:00
AudricV
7607688cb0
[Soundcloud] Remove DRM-protected and downloadable formats extraction
DRM-protected streams have been added to some tracks, mostly from
major music companies. We do not support DRM streams in the extractor,
so they shouldn't be extracted and so waste time, energy and resources.

Extracting downloadable format requires login for a pretty long time,
so there is no point again to do requests to extract this stream to get
an unauthorized response.

Also send the track_authorization property returned in the track info,
like the website does and allow duplicate MP3 formats in progressive and
HLS delivery methods to be returned.
2025-01-28 21:52:28 +01:00
litetex
222d869efc
Polish: Use ternary instead of if 2025-01-27 22:32:01 +01:00
litetex
625e9f96d2
Remove public modifier from tests 2025-01-27 22:24:15 +01:00
Isira Seneviratne
e475b2971b
Restore URL check 2025-01-27 22:21:47 +01:00
Isira Seneviratne
0352659e2b
Use BufferedReader#lines() 2025-01-27 22:21:47 +01:00
litetex
d5ade940fc
Merge pull request #1265 from gechoto/update-ios-client
[YouTube] Update IOS client
2025-01-27 22:17:53 +01:00
Stypox
f7adeeff90
Fix checkstyle 2025-01-26 16:09:22 +01:00
Stypox
1ca8275419
Merge pull request #1253 from gechoto/fix-n-func
[YouTube] Fixes for n param deobfuscation function
2025-01-26 15:15:00 +01:00
gechoto
4b16b7ee41
YoutubeParsingHelper: update IOS client 2025-01-26 13:47:30 +00:00
Stypox
b74a8d0df8
Remove manually writing cardinals of regexes 2025-01-26 13:07:23 +01:00
Stypox
2b70b5f737
Improve new regex to account for more context 2025-01-26 13:07:23 +01:00
gechoto
ca9f1935d3
YoutubeThrottlingParameterUtils: make third regex longer to ensure it is a function which takes one parameter 2025-01-26 13:07:23 +01:00
gechoto
c7d598869c
YoutubeThrottlingParameterUtils: swap regex positions again 2025-01-26 13:07:23 +01:00
gechoto
14f7ef1093
YoutubeThrottlingParameterUtils: add back second regex and swap it with the third one 2025-01-26 13:07:23 +01:00
gechoto
d007e368f3
don't commit testing code kids 2025-01-26 13:07:23 +01:00
gechoto
4181625c2c
add comment to throttling parameter deobfuscation function fixup 2025-01-26 13:07:23 +01:00
gechoto
e0d39b606c
correct comment 2025-01-26 13:07:23 +01:00
gechoto
1393644f44
formatting again 2025-01-26 13:07:23 +01:00
gechoto
68465b27fe
fix formatting 2025-01-26 13:07:23 +01:00
gechoto
56595bd9d5
[YouTube] Fix extraction of n param deobfuscation function name and fixup function to prevent early return 2025-01-26 13:07:23 +01:00
litetex
1c45d4e240
Fix incorrect iPhone model 2025-01-23 22:08:59 +01:00
litetex
cca3e3ffc0
Use more specific exception 2025-01-23 22:08:59 +01:00
litetex
17f0b0d7d3
Fix checkstyle 2025-01-23 21:49:27 +01:00
litetex
746b36e80d
Improve tests
* Dedup using parameterized tests
* Make ``now`` controllable
2025-01-23 21:48:29 +01:00
Isira Seneviratne
ae07ba3c72
Remove unused method in TimeAgoParser 2025-01-23 20:56:16 +01:00
ThetaDev
936bf2d71b
Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/YoutubeParsingHelper.java
Co-authored-by: Stypox <stypox@pm.me>
2025-01-21 23:09:40 +01:00
Stypox
5b31ff20e5
iPhone 15 Pro Max instead of 16 in comments 2025-01-21 23:09:00 +01:00
ThetaDev
45645b043b
update comment 2025-01-21 13:12:51 +01:00
ThetaDev
65d888f4cf
move ProtoBuilder, add tests, fix incompatible rand call 2025-01-21 03:05:54 +01:00
ThetaDev
40059ed687
fix: update iOS client, add visitor data to YouTube requests 2025-01-19 19:59:10 +01:00
TobiGr
8e92227b2e Fix JDoc 2024-11-24 17:15:36 +01:00
Stypox
9fb03f6c87
Merge pull request #1192 from TeamNewPipe/user-agent
[tests] Update user agent
2024-11-18 17:13:55 +01:00
TobiGr
e4a1a6ecd8 Fix tests 2024-11-17 21:38:47 +01:00
TobiGr
727e791602 [YouTube] Update mocks 2024-11-17 21:38:46 +01:00
TobiGr
d635d4db2a Make RecordingDownloader more resillient against ReCaptchaExceptions
Implement a max number of requests per minute to prevent hitting reate limits and triggering ReCaptchaExceptions. This slows down the RecordingDownloader significantly and can be adjusted if needed. A request ist retried once when facing a ReCaptchaException.
2024-11-17 21:38:46 +01:00
Stypox
c00d0a7028
Revert "Refactored Identifiers (#1205)"
This reverts commit 0de224124be656b5792235303b7ce4dd0063165f.
2024-11-16 14:00:38 +01:00
Stypox
d3d5f2b3f0
Merge pull request #1240 from AudricV/yt_fix-playlists-items-extraction
[YouTube] Add support for new playlist items data structure
2024-11-14 16:37:35 +01:00
congyuluo
0de224124b
Refactored Identifiers (#1205)
Extractor.pageFetched -> Extractor.isPageFetched
Stream.equalStats(Stream) is renamed to Stream.areStatsEqual(Stream)
Stream.getBitrate() is renamed to Stream.getBitRate()
2024-11-13 10:01:20 +01:00
AudricV
183563cc9e
[YouTube] Add support for playlists lockupViewModels
This new data type, A/B tested or rolled out at the time the changes
are commited, is present on multiple surfaces.
2024-11-10 21:44:06 +01:00
AudricV
f52d2269fc
[YouTube] Move channel verified status check from badges to a method
This method will be used in more places such as the new playlist item
data.

Support for a new icon used in artist channels has been also added.
2024-11-10 20:18:04 +01:00
TobiGr
667c867ad8 Update user agent to Firefox ESR 128 2024-11-10 17:27:22 +01:00
AudricV
06b2c8e2aa
[YouTube] Fix Shorts' thumbnails extraction in their channel tab
Wrong methods were used to access and extract the thumbnails' data.
This has been fixed with this commit.
2024-11-06 09:31:42 +01:00
Tobi
c343e31ed2
Merge pull request #1236 from Thompson3142/fix_scrubbing_seekbar_preview_crash
Add documentation for faulty framesets
2024-10-27 14:42:06 +01:00
TobiGr
1f26c12098 Use JDoc and inherit doc 2024-10-27 09:45:15 +01:00
AudricV
8a3350f79d
[YouTube] Add support for automatic dubbed and secondary tracks 2024-10-26 20:32:39 +02:00
Thompson3142
542867ff4d Add documentation for faulty framesets 2024-10-24 19:36:35 +02:00