AudricV
3878696b2c
[YouTube] Add support for poTokens, refactor player clients' fetching
...
Also improve detection of age-restricted statuses in playability error
messages returned by the service and provide version 7 of DASH
manifests.
2025-02-05 09:56:52 +01:00
AudricV
9d2b840cfb
[YouTube] Add utility class to handle player requests fetching
...
This internal class, YoutubeStreamHelper, has to be public in order to
be used by subpackages of the service's root one.
It supports poTokens, HTML5 signatureTimestamp property, embed context
and multiple InnerTube clients. It is meant to replace the
corresponding methods in YoutubeParsingHelper, in order to reduce the
class' size, code duplicates and improve its readability.
It adds a new way to get age-restricted videos' streams, the only ones
which are playable in YouTube embeds, which is not very common.
2025-02-05 09:56:52 +01:00
AudricV
1df0267440
[YouTube] Make client and origin HTTP headers methods package-private
...
This allows their internal usage in an upcoming new class to be used on
other InnerTube clients than the WEB one.
2025-02-05 09:56:52 +01:00
AudricV
3691fc22c6
[YouTube] Add an interface and a class to fetch and provide poTokens
2025-02-05 09:56:52 +01:00
AudricV
fd82ec585b
[YouTube] Move to their own file and update clients' constants
...
Also update client version and device info and add TVHTML5 client and
WEB_EMBEDDED_PLAYER constants, these will be used in the future.
TVHTML5_SIMPLY_EMBED_CLIENT_VERSION has been kept in its place as
the corresponding client does not work anonymously anymore, so it will
be removed soon.
2025-02-05 09:56:52 +01:00
AudricV
a336a8ca97
[Soundcloud] Update SoundcloudStreamExtractorTest with latest changes
2025-01-28 21:52:29 +01:00
AudricV
7607688cb0
[Soundcloud] Remove DRM-protected and downloadable formats extraction
...
DRM-protected streams have been added to some tracks, mostly from
major music companies. We do not support DRM streams in the extractor,
so they shouldn't be extracted and so waste time, energy and resources.
Extracting downloadable format requires login for a pretty long time,
so there is no point again to do requests to extract this stream to get
an unauthorized response.
Also send the track_authorization property returned in the track info,
like the website does and allow duplicate MP3 formats in progressive and
HLS delivery methods to be returned.
2025-01-28 21:52:28 +01:00
litetex
222d869efc
Polish: Use ternary instead of if
2025-01-27 22:32:01 +01:00
litetex
625e9f96d2
Remove public modifier from tests
2025-01-27 22:24:15 +01:00
Isira Seneviratne
e475b2971b
Restore URL check
2025-01-27 22:21:47 +01:00
Isira Seneviratne
0352659e2b
Use BufferedReader#lines()
2025-01-27 22:21:47 +01:00
litetex
d5ade940fc
Merge pull request #1265 from gechoto/update-ios-client
...
[YouTube] Update IOS client
2025-01-27 22:17:53 +01:00
Stypox
f7adeeff90
Fix checkstyle
2025-01-26 16:09:22 +01:00
Stypox
1ca8275419
Merge pull request #1253 from gechoto/fix-n-func
...
[YouTube] Fixes for n param deobfuscation function
2025-01-26 15:15:00 +01:00
gechoto
4b16b7ee41
YoutubeParsingHelper: update IOS client
2025-01-26 13:47:30 +00:00
Stypox
b74a8d0df8
Remove manually writing cardinals of regexes
2025-01-26 13:07:23 +01:00
Stypox
2b70b5f737
Improve new regex to account for more context
2025-01-26 13:07:23 +01:00
gechoto
ca9f1935d3
YoutubeThrottlingParameterUtils: make third regex longer to ensure it is a function which takes one parameter
2025-01-26 13:07:23 +01:00
gechoto
c7d598869c
YoutubeThrottlingParameterUtils: swap regex positions again
2025-01-26 13:07:23 +01:00
gechoto
14f7ef1093
YoutubeThrottlingParameterUtils: add back second regex and swap it with the third one
2025-01-26 13:07:23 +01:00
gechoto
d007e368f3
don't commit testing code kids
2025-01-26 13:07:23 +01:00
gechoto
4181625c2c
add comment to throttling parameter deobfuscation function fixup
2025-01-26 13:07:23 +01:00
gechoto
e0d39b606c
correct comment
2025-01-26 13:07:23 +01:00
gechoto
1393644f44
formatting again
2025-01-26 13:07:23 +01:00
gechoto
68465b27fe
fix formatting
2025-01-26 13:07:23 +01:00
gechoto
56595bd9d5
[YouTube] Fix extraction of n param deobfuscation function name and fixup function to prevent early return
2025-01-26 13:07:23 +01:00
litetex
1c45d4e240
Fix incorrect iPhone model
2025-01-23 22:08:59 +01:00
litetex
cca3e3ffc0
Use more specific exception
2025-01-23 22:08:59 +01:00
litetex
17f0b0d7d3
Fix checkstyle
2025-01-23 21:49:27 +01:00
litetex
746b36e80d
Improve tests
...
* Dedup using parameterized tests
* Make ``now`` controllable
2025-01-23 21:48:29 +01:00
Isira Seneviratne
ae07ba3c72
Remove unused method in TimeAgoParser
2025-01-23 20:56:16 +01:00
ThetaDev
936bf2d71b
Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/YoutubeParsingHelper.java
...
Co-authored-by: Stypox <stypox@pm.me>
2025-01-21 23:09:40 +01:00
Stypox
5b31ff20e5
iPhone 15 Pro Max instead of 16 in comments
2025-01-21 23:09:00 +01:00
ThetaDev
45645b043b
update comment
2025-01-21 13:12:51 +01:00
ThetaDev
65d888f4cf
move ProtoBuilder, add tests, fix incompatible rand call
2025-01-21 03:05:54 +01:00
ThetaDev
40059ed687
fix: update iOS client, add visitor data to YouTube requests
2025-01-19 19:59:10 +01:00
TobiGr
8e92227b2e
Fix JDoc
2024-11-24 17:15:36 +01:00
Stypox
9fb03f6c87
Merge pull request #1192 from TeamNewPipe/user-agent
...
[tests] Update user agent
2024-11-18 17:13:55 +01:00
TobiGr
e4a1a6ecd8
Fix tests
2024-11-17 21:38:47 +01:00
TobiGr
727e791602
[YouTube] Update mocks
2024-11-17 21:38:46 +01:00
TobiGr
d635d4db2a
Make RecordingDownloader more resillient against ReCaptchaExceptions
...
Implement a max number of requests per minute to prevent hitting reate limits and triggering ReCaptchaExceptions. This slows down the RecordingDownloader significantly and can be adjusted if needed. A request ist retried once when facing a ReCaptchaException.
2024-11-17 21:38:46 +01:00
Stypox
c00d0a7028
Revert "Refactored Identifiers ( #1205 )"
...
This reverts commit 0de224124be656b5792235303b7ce4dd0063165f.
2024-11-16 14:00:38 +01:00
Stypox
d3d5f2b3f0
Merge pull request #1240 from AudricV/yt_fix-playlists-items-extraction
...
[YouTube] Add support for new playlist items data structure
2024-11-14 16:37:35 +01:00
congyuluo
0de224124b
Refactored Identifiers ( #1205 )
...
Extractor.pageFetched -> Extractor.isPageFetched
Stream.equalStats(Stream) is renamed to Stream.areStatsEqual(Stream)
Stream.getBitrate() is renamed to Stream.getBitRate()
2024-11-13 10:01:20 +01:00
AudricV
183563cc9e
[YouTube] Add support for playlists lockupViewModels
...
This new data type, A/B tested or rolled out at the time the changes
are commited, is present on multiple surfaces.
2024-11-10 21:44:06 +01:00
AudricV
f52d2269fc
[YouTube] Move channel verified status check from badges to a method
...
This method will be used in more places such as the new playlist item
data.
Support for a new icon used in artist channels has been also added.
2024-11-10 20:18:04 +01:00
TobiGr
667c867ad8
Update user agent to Firefox ESR 128
2024-11-10 17:27:22 +01:00
AudricV
06b2c8e2aa
[YouTube] Fix Shorts' thumbnails extraction in their channel tab
...
Wrong methods were used to access and extract the thumbnails' data.
This has been fixed with this commit.
2024-11-06 09:31:42 +01:00
Tobi
c343e31ed2
Merge pull request #1236 from Thompson3142/fix_scrubbing_seekbar_preview_crash
...
Add documentation for faulty framesets
2024-10-27 14:42:06 +01:00
TobiGr
1f26c12098
Use JDoc and inherit doc
2024-10-27 09:45:15 +01:00