kavin/NewPipeExtractor
1
0
Fork 0
mirror of https://github.com/TeamNewPipe/NewPipeExtractor.git synced 2024-12-12 21:30:33 +05:30
Code Issues Projects Releases Wiki Activity
2,697 Commits 10 Branches 75 Tags 199 MiB
dev
Commit Graph

2697 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
AudricV
f9792cf3a9
[YouTube] Fix InteractiveTabbedHeader.testTabs test 
YouTube now returns a Shorts tab for InteractiveTabbedHeader gaming channels,
which contains Shorts about the game of the topic channel but are not uploaded
on the game topic channel.

As this tab is already supported by the extractor, fetching a gaming topic
channel now returns a tab instead of none.

Channel name and channel URL of these Shorts needs to be set to null in a
separate commit, as Shorts on this tab do not have the topic channel as their
uploader.
 2024-04-11 18:59:10 +02:00
AudricV
f40fc0aa4f
[YouTube] Add support for new crisis meta info action data 
The new action data can return multiple contact actions instead of only one,
which will be concatenated by a new line return.

This commit fixes tests of the CrisisResources test class of
YoutubeSearchExtractorTest.
 2024-04-11 18:59:09 +02:00
AudricV
2a3c6f80d2
[YouTube] Fix YoutubeStreamExtractorRelatedMixTest 2024-04-10 21:19:03 +02:00
AudricV
657b4377aa
[YouTube] Fix YoutubeStreamExtractorDefaultTest tests 2024-04-10 21:19:03 +02:00
AudricV
7bf50bf1cb
[YouTube] Update Android client player parameters 
YouTube disabled the effectiveness of the parameters which were used (the
player response we get redirects to another video), but new parameters which
work around Android's client integrity checks have been found.
 2024-04-10 21:19:03 +02:00
AudricV
27dc1b1f50
[YouTube] Remove usage of API keys for InnerTube requests, bump versions 
The API keys are not used anymore by official clients in almost all cases
(still used by the Android app until it gets a configuration) for all requests
we made.

Clients and device OS versions have been bumped to their latest stable version
known.

Methods and fields related to API keys have been renamed or deleted if they're
no longer relevant.
 2024-04-10 21:19:02 +02:00
AudricV
e380bb4bc3
[YouTube] Add missing prettyPrint query parameter to mixes continuations 2024-04-10 19:06:36 +02:00
Audric V
6c3c2e25d7
Merge pull request #1163 from AudricV/yt-fix_comments_extraction 
[YouTube] Support new comments data
 2024-04-10 18:19:59 +02:00
Stypox
02274d5395
[YouTube] Avoid XSS attacks in description or comments 2024-04-08 11:21:31 +02:00
Stypox
3f7b2653e3
[YouTube] Add YoutubeDescriptionHelperTest 2024-04-08 11:21:31 +02:00
Stypox
a90237816a
[YouTube] Cleanup description helper 
Remove unneeded isClose field, and make constants private
 2024-04-08 11:21:31 +02:00
Stypox
b80c3f5d51
[YouTube] Replace link text with accessibility label 2024-04-08 00:14:28 +02:00
Stypox
09732d6785
[YouTube] Add support for styles in attributed descriptions 
Also refactor descriptions parsing.
 2024-04-04 21:14:27 +02:00
AudricV
293c3e9e47
[YouTube] Support new A/B tested comments data 
Also improve current comments code by removing outdated comment
renderer data.
 2024-04-04 21:14:26 +02:00
Stypox
e5b30ae8c3
Merge pull request #1151 from Profpatsch/localization-return-optional 
LocaleCompat.forLanguageTag: return Optional if parsing fails
 2024-03-29 13:50:48 +01:00
Stypox
23fc7aa209
Throw ParsingException instead of IllegalArg 2024-03-29 13:44:42 +01:00
Stypox
fb468a23f4
Merge pull request #1142 from TeamNewPipe/peertube-v6 
[PeerTube] Add support for PeerTube v6 features
 2024-03-29 12:25:38 +01:00
Stypox
6589e2c15d
Merge pull request #1148 from Stypox/mediaccc-channel-tab-handler 
[MediaCCC] Allow obtaining channel tab link handler
 2024-03-28 13:45:05 +01:00
Tobi
ad71864b23
Merge pull request #1162 from Stypox/fix-comment-description-npe 
Make getCommentText @Nonnull
 2024-03-27 20:04:17 +01:00
Stypox
c57016b79b
Make getCommentText @Nonnull 2024-03-27 15:26:06 +01:00
Tobi
adcc1f17ee
Merge pull request #1160 from TeamNewPipe/fix/tests 
Fix some failing unit tests and detect new account termination messages for YouTube
 2024-03-20 15:17:55 +01:00
TobiGr
51ddacc81d [SoundCloud] Fix SoundcloudSearchExtractorTest.NoNextPage 
Search did not return no item at all, causing a NothingFoundException. New search query yields three items on first page
 2024-03-20 15:10:39 +01:00
TobiGr
8392d50ba6 Update mocks for YoutubeChannelExtractorTest.NotAvailable 2024-03-20 14:59:44 +01:00
TobiGr
aaccfecda8 [YouTube] Detect new account termination messages 2024-03-20 14:57:41 +01:00
TobiGr
73f0c63a9d [PeerTube] Fix tests for "What is PeerTube?" video 2024-03-20 14:44:06 +01:00
Tobi
896a55e319
Merge pull request #1139 from TeamNewPipe/dependabot/github_actions/actions/upload-artifact-4 
Bump actions/upload-artifact from 3 to 4
 2024-03-18 08:59:35 +01:00
dependabot[bot]
e58fc652e0
Bump actions/upload-artifact from 3 to 4 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 3 to 4.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-03-18 07:53:24 +00:00
Tobi
e3f2c9aec7
Merge pull request #1153 from TeamNewPipe/dependabot/github_actions/actions/cache-4 
Bump actions/cache from 3 to 4
 2024-03-18 08:51:24 +01:00
Tobi
6b0fc14c04
Merge pull request #1156 from TeamNewPipe/dependabot/gradle/org.junit-junit-bom-5.10.2 
Bump org.junit:junit-bom from 5.10.0 to 5.10.2
 2024-03-18 08:46:13 +01:00
dependabot[bot]
d579b608e5
Bump org.junit:junit-bom from 5.10.0 to 5.10.2 
Bumps [org.junit:junit-bom](https://github.com/junit-team/junit5) from 5.10.0 to 5.10.2.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.10.0...r5.10.2)

---
updated-dependencies:
- dependency-name: org.junit:junit-bom
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-02-05 09:15:26 +00:00
TobiGr
fe47a4311f [PeerTube] Add test for segments and framesets 2024-01-29 10:22:06 +01:00
TobiGr
15e0e74b48 [PeerTube] Add support for stream frames/storyboards extraction 
Implement PeerTubeStreamExtractor.getFrames()
 2024-01-29 10:22:06 +01:00
dependabot[bot]
da04eded5d
Bump actions/cache from 3 to 4 
Bumps [actions/cache](https://github.com/actions/cache) from 3 to 4.
- [Release notes](https://github.com/actions/cache/releases)
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md)
- [Commits](https://github.com/actions/cache/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/cache
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-18 09:32:42 +00:00
Profpatsch
7408173246 LocaleCompat.forLanguageTag: return Optional if parsing fails 
It’s not obvious that the function will fail in some cases and throw
an `IllegalArgumentException`.

So instead of just failing if parsing fails, return an Optional that
all callers have to decide what to do (e.g. the YoutubeExtractor can
just ignore the locale in that case, like it does with most other
fields in the json if they are unexpected).
 2024-01-07 14:31:34 +01:00
Stypox
aaf3231fc7
[MediaCCC] Fix lambda link handler keeping reference to extractor 
This caused problems in NewPipe, because extractors are not serializable, and well, keeping references to them is a bad idea anyway.
 2023-12-30 23:23:19 +01:00
Stypox
137e924035
[MediaCCC] Add ChannelTabExtractorTest 2023-12-30 22:53:51 +01:00
Stypox
cc9ade962e
[MediaCCC] Allow obtaining channel tab extractor from scratch 
i.e. without needing to pass through the conference/channel extractor
This was needed because clients (like NewPipe) might rely on link handlers to hold as little data as possible, since they might be kept around for long or passed around in system transactions, so this commit allows obtaining a standalone link handler that does not hold a JsonObject within itself.
 2023-12-30 22:53:27 +01:00
Stypox
3402cdb666
Merge pull request #1147 from petlyh/youtube-albums 
[YouTube] Add Albums channel tab
 2023-12-30 21:58:19 +01:00
petlyh
6dc25f7b97
[YouTube] Add Albums channel tab mocks 2023-12-30 14:46:39 +01:00
petlyh
4408e2d0ac
[YouTube] Add Albums channel tab 2023-12-30 14:01:30 +01:00
TobiGr
9ab932e394 Rename testDoNotAcceptNonURLs() -> assertDoNotAcceptNonURLs() 2023-12-29 16:38:11 +01:00
Stypox
9d66debf3c
Merge pull request #1132 from TeamNewPipe/dependabot/github_actions/actions/setup-java-4 
Bump actions/setup-java from 3 to 4
 2023-12-29 16:20:46 +01:00
Tobi
038ebdedc4
Merge pull request #1143 from petlyh/peertube-non-urls 
Avoid PeerTube accepting non-URLs
 2023-12-29 12:47:30 +01:00
TobiGr
61d237de02 [PeerTube] Test onAccept(String URL) in LinkHandlerFactories for non-URLs 2023-12-29 12:45:02 +01:00
petlyh
2b2c1546d1 Avoid PeerTube accepting non-URLs 2023-12-29 12:27:39 +01:00
Tobi
1e93b1dc20
Merge pull request #1135 from Stypox/yt-emergency-info 
[YouTube] Implement emergency meta info
 2023-12-29 12:01:40 +01:00
dependabot[bot]
3400af99b3
Bump actions/setup-java from 3 to 4 
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 3 to 4.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/setup-java
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-29 10:57:47 +00:00
Tobi
1f8a044462
Merge pull request #1138 from TeamNewPipe/dependabot/gradle/com.github.spotbugs-spotbugs-annotations-4.8.3 
Bump com.github.spotbugs:spotbugs-annotations from 4.8.0 to 4.8.3
 2023-12-29 11:56:18 +01:00
dependabot[bot]
1470aa7303
Bump com.github.spotbugs:spotbugs-annotations from 4.8.0 to 4.8.3 
Bumps [com.github.spotbugs:spotbugs-annotations](https://github.com/spotbugs/spotbugs) from 4.8.0 to 4.8.3.
- [Release notes](https://github.com/spotbugs/spotbugs/releases)
- [Changelog](https://github.com/spotbugs/spotbugs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/spotbugs/spotbugs/compare/4.8.0...4.8.3)

---
updated-dependencies:
- dependency-name: com.github.spotbugs:spotbugs-annotations
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-29 10:53:28 +00:00
TobiGr
8f9ebdcb77 [PeerTube] Fix failing PeertubeTrendingLinkHandlerFactoryTest 
The factory was updated in #1144
 2023-12-29 11:52:19 +01:00