1929 Commits

Author	SHA1	Message	Date
Stypox	421935401f	[Youtube] Add subchannel functions to mix and fix imports	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	3ff8619bcc	[Youtube] apply wb9688 suggestion (mix) ... Channel mix adjusments and test Don't accept youtube music mix urls as playlist Don't override playlistData to keep getInitialPage() Remove json constants Indentation	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	822cf307f7	[Youtube] Add _ITEMS constants and improve code style ... Move thumbnail id exctraction code to getThumbnailUrlFromId Add test for "My mix" detection to service tests Use ITEM_COUNT_UNKNOWN everywhere instead of -1 and add some tests	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	df38b1926c	[Youtube] Add tests and take thumbnail image always from first video of mix ... Also fix getThumbnailUrl for "My Mix"	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	68a3948af6	[Youtube] Fix get banner url	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	ec6b99c082	[Youtube] Adjust mix extractor to new user agent ... Also extract continuation now	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	0ff054acb4	[Youtube] Extract initial playlist info	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	a376792a5d	[Youtube] Handle case where url is in "youtube.com/playlist?list=listID" format. ... This occurs when sharing a mix from the official youtube app.	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	327a5730a8	[Youtube] Add some comments to mix	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	d74265c846	[Youtube] Extract getThumbnailUrl into method and change getUploaderName	2020-12-12 20:30:57 +01:00
Xiang Rong Lin	0efb854d27	[Youtube] Implement mix extractor for auto-generated playlists. ... -New YoutubeMixPlaylistExtractor, that extracts from a mix (auto-generated playlist). -The url has the format of "youtube.com/watch?v=videoID&playlistID", where playlistID always starts with "RD" and usually followed by the videoID. -Change YoutubePlaylistLinkHandlerFactory to create a linkhandler with the given url if it is a mix. -Change YoutubeService to return YoutubeMixPlaylistExtractor if the url is a mix.	2020-12-12 20:30:57 +01:00
vkay94	2ba27b39af	Stream segments: Remove replaceAll from setPreviewUrl	2020-12-12 15:00:45 +01:00
vkay94	9a7a224a54	Add tests for stream segments	2020-12-12 10:24:55 +01:00
vkay94	d3eea4f4be	Add stream segments to StreamInfo	2020-12-12 10:24:29 +01:00
Isira Seneviratne	57be1f1123	Use Objects.requireNonNull().	2020-12-11 06:09:57 +05:30
Isira Seneviratne	4c19a88612	Use Objects.toString().	2020-12-11 06:09:50 +05:30
Isira Seneviratne	b8f64595a2	Use Objects' static equals() and hashCode() methods.	2020-12-11 06:09:44 +05:30
vkay94	9dbacbc618	Fix comments parsing	2020-12-09 14:57:38 +01:00
Fynn Godau	04dd3d4d32	Rework link handlers to correctly accept external websites	2020-12-05 15:08:26 +01:00
TheAssassin	ba3e2302bc	Fix name of media.ccc.de service	2020-12-01 23:54:27 +01:00
Tobias Groza	b7a995187f	Merge pull request #463 from opusforlife2/update_invidious_URLs ... Update Invidious URL List	2020-11-28 13:30:32 +01:00
Fynn Godau	be562b8436	Change tests	2020-11-27 16:48:40 +01:00
TobiGr	c91e21b37c	[Bandcamp] Tests - Add finals and improve code formatting	2020-11-24 14:13:31 +01:00
TobiGr	99e7ef013e	[Bandcamp] Apply small changes to code formatting and style ... Make variables final when possible Remove unused imports Improve code formatting	2020-11-24 14:13:31 +01:00
fynngodau	8c369b0f79	Rephrase link in javadoc ... Co-authored-by: Tobias Groza <TobiGr@users.noreply.github.com>	2020-11-24 14:01:31 +01:00
Tobias Groza	650f0920fe	Merge pull request #465 from XiangRongLin/playlist_continuation ... [YouTube] Fix playlist continuations extraction	2020-11-20 20:48:20 +01:00
TobiGr	334e1e9b53	Fix YouTube comments test	2020-11-20 19:53:53 +01:00
Fynn Godau	186936d041	Various changes regarding tests	2020-11-19 22:33:52 +01:00
Fynn Godau	6bc7e3420e	Merge TNP/dev into fynngodau/dev	2020-11-19 21:32:08 +01:00
XiangRongLin	5bceff0083	[YouTube] Fix extraction of next page url for the last page of playlist	2020-11-18 19:03:12 +01:00
XiangRongLin	8347e14952	[YouTube] Fix playlist continuations extraction	2020-11-17 21:04:53 +01:00
opusforlife2	2174055ef8	Update Invidious URL list in Parsing Helper	2020-11-11 15:12:31 +00:00
opusforlife2	c0afd5213a	Update Invidious URL list in Link Handler Factory	2020-11-11 14:54:16 +00:00
Stypox	89a77ae74a	[YouTube] Fix detection of ended livestreams and parse livestream upload date	2020-11-04 16:03:08 +01:00
Stypox	827f7bd137	[YouTube] Cache deobfuscation and improve requests made ... Fix age restriction extraction Automatically fixes more things	2020-11-04 16:02:12 +01:00
Isira Seneviratne	4fe28d7e3a	Fix YouTube parse error when only a date is present.	2020-11-04 05:49:42 +05:30
Isira Seneviratne	9cf9e7e980	Call existing constructor in DateWrapper.	2020-11-04 05:49:41 +05:30
Isira Seneviratne	fe31a90cb3	Remove DateTimeFormatter.ISO_OFFSET_DATE_TIME usage.	2020-11-04 05:49:41 +05:30
Tobias Groza	b13c7e1c1e	Merge pull request #452 from Stypox/yt-import ... Implement YouTube subscription import from Google takeout	2020-11-03 20:32:17 +01:00
bopol	345e136f6c	create YouTubeCommentsLinkHandlerFactoryTest ... and remove invidious test from YouTubeCommentsExtractorTest, because it was just testing if the URL is accepted, then the extractor does the same thing, we don't need to test the same thing twice	2020-11-03 19:10:10 +01:00
Stypox	501ec30152	Implement youtube subscription import from Google takeout	2020-11-02 11:04:48 +01:00
Bri@n	82746d172f	Fix typo in DonationLinkHelper and rewrote swtich statement	2020-11-01 17:34:34 -05:00
Stypox	2f02c0e6a4	Merge pull request #450 from B0pol/fileutils ... create FileUtils	2020-11-01 18:13:57 +01:00
bopol	f69b3ef05d	create FileUtils	2020-11-01 17:15:34 +01:00
TobiGr	be9e160333	Fix build	2020-11-01 17:04:02 +01:00
Isira Seneviratne	4f04cfccca	Switch from Calendar to OffsetDateTime in DateWrapper.	2020-11-01 06:28:54 +05:30
Isira Seneviratne	ee3af63c04	Switch to ChronoUnit.	2020-11-01 06:28:53 +05:30
Stypox	6cc50b57e3	Merge pull request #410 from Scrxtchy/sets-track-title ... Fix parsing Soundcloud tracks that contain the term 'sets'	2020-10-31 21:43:21 +01:00
Stypox	b242e1d113	Merge pull request #362 from Stypox/google-search-urls ... Add support for Google search redirect url	2020-10-31 21:03:48 +01:00
Stypox	9e53cf0b56	Fix parameter reassignment and other style issues ... Also remove left-behind debug statement	2020-10-31 20:58:28 +01:00
Stypox	3fe55b30ba	Add support for Google search redirect url	2020-10-31 20:58:28 +01:00
Stypox	c190a3029b	Consider protocol as base url when it is a custom one (e.g. vnd.youtube)	2020-10-31 20:58:28 +01:00
bopol	b21e59925d	[PeerTube] fix account and channel extractors	2020-10-29 19:52:29 +01:00
Stypox	30ed4f2d63	Remove any reference to decrypt and improve error message	2020-10-28 20:26:00 +01:00
TobiGr	62912ee834	Merge branch 'master' into dev	2020-10-28 14:28:06 +01:00
Scratch	947ce3ee10	Fix parsing Soundcloud tracks that contain the term 'sets'	2020-10-28 07:55:02 +11:00
bopol	6dc5ab4015	find playerUrl in another place when assetsPattern regex fails	2020-10-27 13:48:58 +01:00
bopol	db0ef83d6b	fix youtube decryption and three attemps bug ... fixes teamnewpipe/newpipe#4572 fixes #439	2020-10-27 13:40:24 +01:00
bopol	c1e9857960	fix subscriber count when subscribe is disabled ... fixes #305	2020-10-26 19:06:01 +01:00
bopol	a39a2cca82	fix redirect channels	2020-10-26 19:05:19 +01:00
bopol	0a12300c5e	polish tests	2020-10-26 16:57:37 +01:00
bopol	01f49e8f66	polish strings	2020-10-26 16:32:39 +01:00
Tobias Groza	14c0c37d64	Merge pull request #309 from Stypox/improve-stream-tests ... Improve stream extractor tests & various fixes	2020-10-25 18:49:53 +01:00
Kiril Isakov	366ed71523	[YouTube] Ignore leading characters in video id	2020-10-25 14:34:20 +01:00
Stypox	8026304a0a	Merge pull request #409 from Bartoshr/bugfix/short-channel-urls ... Support short custom YouTube channel URLs	2020-10-25 11:43:50 +01:00
Stypox	57e7994c9e	Add some missing finals, nullables and comments	2020-10-25 08:12:41 +01:00
Stypox	f11fe87688	[YouTube] Replace outdated PewDiePie video test with another one ... The old video was made private, and this video (wedding) is probably never going to be removed.	2020-10-24 18:41:41 +02:00
Stypox	3c55ea9321	[PeerTube] Change age restricted video in tests ... The old one wasn't available anymore	2020-10-24 18:41:41 +02:00
Stypox	880ff04a5c	[Test] Add stream dash mpd url test	2020-10-24 18:41:41 +02:00
Stypox	d0b14644bb	[YouTube/MediaCCC] Consider dates as GMT and not as local	2020-10-24 18:41:41 +02:00
Stypox	8ce711f40f	[Test] Add sub channel name, url and thumbnail tests	2020-10-24 18:41:41 +02:00
Stypox	6127826571	[Test] Add stream metadata tests	2020-10-24 18:41:41 +02:00
Stypox	a087b092b4	[Test] Improve code style and add final	2020-10-24 18:39:55 +02:00
Stypox	a4097d8d01	[MediaCCC] Return empty list of video-only streams instead of null	2020-10-24 18:39:55 +02:00
Stypox	8dc3f28618	[PeerTube] Test one channel url with api and one without	2020-10-24 18:39:55 +02:00
Stypox	68d23defba	[YouTube] Do not catch every exception on getErrorMessage ... @B0pol suggestion	2020-10-24 18:39:55 +02:00
Stypox	3191bd6c70	[YouTube] Use final when possible	2020-10-24 18:39:55 +02:00
Stypox	55bc01d1ce	[SoundCloud] Use final when possible, ide refactorings	2020-10-24 18:39:55 +02:00
Stypox	06430c4749	[PeerTube] Use final when possible, ide refactorings	2020-10-24 18:39:06 +02:00
Stypox	fcb9b6f855	[MediaCCC] Use final when possible, ide refactorings ... Refactorings on `throws` clause	2020-10-24 18:36:22 +02:00
Stypox	af5b8b1915	[MediaCCC] Add tests for stream and conference link handlers	2020-10-24 18:36:21 +02:00
Stypox	07a90d116a	[MediaCCC] Use regex to parse stream and conference urls	2020-10-24 18:36:21 +02:00
Stypox	0c980b2d64	[PeerTube] Improve channel and stream link handler tests	2020-10-24 18:36:21 +02:00
Stypox	d130fd79c3	[PeerTube] Prepend "accounts/" to channel id for backward compatibility	2020-10-24 18:36:21 +02:00
Stypox	492db83ccf	[MediaCCC] Return null instead of empty items collector ... As per the documentation in the base getRelatedStreams()	2020-10-24 18:34:57 +02:00
Stypox	3b2a1829d4	[MediaCCC] Extract tags	2020-10-24 18:34:57 +02:00
Stypox	b461da792f	[MediaCCC] Fix link handler inconsistency providing API links	2020-10-24 18:34:34 +02:00
Stypox	aeeae87641	[PeerTube] Parse timestamp from url (previously unimplemented)	2020-10-24 18:33:42 +02:00
Stypox	7ae3cb6d07	[PeerTube] Fix link handler inconsistency providing API links	2020-10-24 18:33:11 +02:00
Stypox	4349be13af	[PeerTube] Return empty audio stream list instead of null	2020-10-24 18:25:56 +02:00
Stypox	3b2cfb4ca2	[SoundCloud] Return empty video stream list instead of null ... Also replace every instance of `return new ArrayList<>();` with `return Collections.emptyList();`	2020-10-24 18:23:46 +02:00
Stypox	072bae321f	[YouTube] Fix frame extraction for livestreams ... Use saved playerResponse instead of parsing json every time	2020-10-24 18:23:46 +02:00
Stypox	7cd410f3fc	[YouTube] Return 0 when there is no timestamp, not -2, as per javadoc	2020-10-24 18:23:45 +02:00
Stypox	7fb867c166	[YouTube] Fix error message obtaining when there is none	2020-10-24 18:22:44 +02:00
Stypox	1d7a86e664	[Test] Add base classes for stream extractor tests ... Refactor all stream extractor tests to use new base class. Remove check if upload date is in the past: this does not have to hold true: youtube premieres turn up in search results even though they are in the future	2020-10-24 18:22:44 +02:00
Bartosz Rumiński	29695aed0a	Small field refactor	2020-10-23 16:42:30 +02:00
Bartosz Rumiński	0e67d820bc	Use static regex pattern for excluded path segments	2020-10-22 20:13:29 +02:00
Bartosz Rumiński	d3f80d1538	Exlude links which are not channels	2020-10-20 20:06:06 +02:00
Stypox	6887d59570	[YouTube] Handle urls for Shorts	2020-10-18 12:03:01 +02:00
Scratch	e945f711c1	Fix SoundCloud test artist account name (#416)	2020-10-16 23:42:46 +02:00
wb9688	be9a6f931c	Fix parsing new ytInitialData	2020-10-16 20:27:40 +02:00
Tobias Groza	1a9bc8caf1	Merge pull request #414 from Scrxtchy/soundcloud-slash ... Remove tailing slash from SoundCloud URLs	2020-10-16 09:48:44 +02:00
Scratch	6a70cb9d50	Remove tailing slash from SoundCloud URLs ... Fixes #412	2020-10-16 17:17:40 +11:00
Tobias Groza	9a785f9a7e	Merge pull request #413 from Scrxtchy/soundcloud-test-update ... Fix SoundCloud test artist account name	2020-10-16 08:05:44 +02:00
Scratch	538f5d3973	Fix SoundCloud test artist account name	2020-10-16 13:45:05 +11:00
Stypox	19e862657a	[YouTube] Fix some decryption exceptions by retrying	2020-10-15 20:16:44 +02:00
Bartosz Rumiński	e3f996e014	Exlude links which are not channels	2020-10-12 20:59:56 +02:00
Bartosz Rumiński	5ab1b053d2	Update youtube channel link handler tests ... Co-authored-by: Tobias Groza <TobiGr@users.noreply.github.com>	2020-10-12 20:11:28 +02:00
Bartosz Rumiński	7abb4b3713	Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/linkHandler/YoutubeChannelLinkHandlerFactory.java ... Fix typos Co-authored-by: Tobias Groza <TobiGr@users.noreply.github.com>	2020-10-12 19:57:45 +02:00
Bartosz Rumiński	9d63211a66	Fix typos ... Co-authored-by: Tobias Groza <TobiGr@users.noreply.github.com>	2020-10-12 19:56:53 +02:00
Bartosz Rumiński	8c38a5509e	Prevent attribution_link urls to be accepted by channel links handler	2020-10-09 19:07:38 +02:00
Bartosz Rumiński	4e04991762	Support short custom youtube channel urls	2020-10-09 17:06:59 +02:00
Fynn Godau	81b5e7cf3d	Fix extractor	2020-10-08 17:56:03 +02:00
wb9688	ebbfe7f6d4	Skip YouTube's OTF streams	2020-09-29 10:48:02 +02:00
Tobias Groza	6633f26ec5	Merge pull request #386 from mhmdanas/remove-subtitles-stream-get-url ... Remove SubtitlesStream#getURL()	2020-08-26 21:32:36 +02:00
wb9688	7657c2ed1a	Use initSafeStandardsObjects()	2020-08-15 17:08:07 +02:00
mhmdanas	1a63dcb355	Remove overriden field url	2020-08-12 22:37:36 +03:00
mhmdanas	f0f1c009b2	Remove SubtitlesStream#getURL()	2020-08-10 19:28:56 +03:00
Fynn Godau	cfe88a74c1	Throw ContentNotSupportedException when opening radio uploader channel	2020-08-09 10:07:49 +02:00
TobiGr	0fb73301e3	[YouTube] Fix crash on empty comment ... Closes #380	2020-08-05 18:25:40 +02:00
Fynn Godau	932d094d6a	Upgrade featured playlist urls to https	2020-08-02 16:55:18 +02:00
Fynn Godau	c12ef3a02d	Merge TNP/dev into fynngodau/dev	2020-08-02 16:43:04 +02:00
TobiGr	5ac80624a4	Fix detection of YouTube's decryption function ... Closes TeamNewPipe/NewPipe#3951	2020-07-28 01:01:10 +02:00
Tobias Groza	32dff1541f	Merge pull request #370 from wb9688/fix-yt-age-restricted ... Fix age restricted YouTube videos	2020-07-26 14:17:19 +02:00
TobiGr	ec778200d9	Add comments to the code	2020-07-26 14:15:13 +02:00
wb9688	667dce034c	Only use fallback methods for clientVersion when clientVersion hasn't been successfully extracted yet	2020-07-26 13:14:25 +02:00
wb9688	f345f667e2	Extract YouTube's key	2020-07-26 12:01:59 +02:00
wb9688	4c987a5302	Support YouTube's new continuations for search	2020-07-26 10:01:03 +02:00
wb9688	81459e289f	Fix age restricted YouTube videos	2020-07-18 19:52:54 +02:00
wb9688	fc3a63fec5	Update Javadoc for getRelatedStreams()	2020-07-15 18:48:37 +02:00
wb9688	ff560e907a	Remove getNextStream() from StreamExtractor	2020-07-15 18:48:37 +02:00
Tobias Groza	a70cb0283f	Merge pull request #314 from wb9688/remove-getnextpageurl ... Next page stuff	2020-07-07 20:49:38 +02:00
wb9688	0a5a905bc7	Add final at more places	2020-07-07 20:45:47 +02:00
wb9688	17ba8a57fa	Clean up the code	2020-07-06 20:19:31 +02:00
wb9688	9b6fe1dea6	Throw IllegalArgumentException when Page is invalid	2020-07-06 20:19:31 +02:00
wb9688	4cc312086a	Introduce Page class	2020-07-06 20:19:31 +02:00
wb9688	e3bfdba135	Remove getNextPageUrl() function from ListExtractor	2020-07-06 20:11:40 +02:00
wb9688	156a26b64b	Support start= timestamps for YouTube	2020-07-06 14:08:40 +02:00
bopol	261471e7f4	remove invidiou.sh from tests ... dead instance	2020-07-02 21:33:45 +02:00
bopol	eb3901acee	update invidious instances	2020-07-02 21:31:05 +02:00
Tobias Groza	c0ceb5cb27	Merge pull request #340 from wb9688/peertube-deleted-comments ... Handle isDeleted for PeerTube comments	2020-06-28 10:21:37 +02:00
Tobias Groza	339f1d9c43	Merge pull request #349 from wb9688/okhttp ... Use OkHttp for tests like in NewPipe	2020-06-27 20:08:02 +02:00
Tobias Groza	970bc7f69d	Merge pull request #359 from mauriciocolli/fix-client-id-bug ... [SoundCloud] Fix concurrency issue when getting the client id	2020-06-27 17:36:24 +02:00
Robin	576754982e	Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/YoutubeParsingHelper.java ... Co-authored-by: Tobias Groza <TobiGr@users.noreply.github.com>	2020-06-27 11:35:01 +02:00
Mauricio Colli	7505e828cc	[SoundCloud] Update client id	2020-06-24 01:50:09 -03:00
Mauricio Colli	d2f1c0f40d	[SoundCloud] Fix concurrency issue when getting the client id	2020-06-24 01:50:08 -03:00
Robin	b63ae93495	Added a comment ... and fixed a "typo" in the method parseDurationString replacing Long with Integer. These are not the droids you are looking for wb9688 😁	2020-06-15 11:27:44 +02:00
Tobias Groza	92f6754f0f	Merge pull request #338 from wb9688/parse-duration-string-test ... Add tests for parseDurationString()	2020-06-15 11:01:21 +02:00
Stypox	5808439c3f	[PeerTube] Change age restricted video in tests ... The old one wasn't available anymore	2020-06-14 19:57:39 +02:00
wb9688	3239aa84f2	Handle isDeleted for PeerTube comments	2020-06-14 19:27:20 +02:00
wb9688	a65e46e4b1	Use OkHttp for tests like in NewPipe	2020-06-11 15:06:08 +02:00
Fynn Godau	96de834b67	Bandcamp: parse date from radio info item	2020-06-04 19:36:58 +02:00
Fynn Godau	39b55b5b42	Bandcamp radio stream extractor: test uploader url	2020-06-04 19:32:19 +02:00
Fynn Godau	9a555d97e5	Remove useless bandcamp tests	2020-06-04 19:31:01 +02:00
Fynn Godau	e13f341a45	Bandcamp stream extractor: test service id	2020-06-04 19:29:37 +02:00
Fynn Godau	4dd9540782	Bandcamp license switch order	2020-06-04 19:27:39 +02:00
Fynn Godau	52103ac61f	Remove "useless" comments	2020-06-04 19:27:13 +02:00
Fynn Godau	8fa81537c0	Better bandcamp stream extractor description test	2020-06-04 19:17:51 +02:00
Fynn Godau	0950a95577	Fix for testing wrong object for null or empty	2020-06-04 19:16:08 +02:00
Fynn Godau	e6ecd91929	Bandcamp: Test full date	2020-06-04 19:12:10 +02:00
Fynn Godau	27e7aad159	Bandcamp: Improve code style	2020-06-04 19:04:25 +02:00
fynngodau	ea49202f64	Don't display internal license id ... Co-authored-by: bopol <bopol@e.email>	2020-06-04 18:26:58 +02:00
bopol	063f4be766	For #342: support PeerTube embeds	2020-06-04 14:26:42 +02:00
Fynn Godau	34b6928124	Don't print stacktrace before throwing new exception	2020-06-04 14:25:38 +02:00
Fynn Godau	1be20ceeec	Bandcamp: parse date	2020-06-04 14:09:21 +02:00
Fynn Godau	6822fe3dc8	Bandcamp: Get Stream upload date	2020-06-04 13:03:16 +02:00
Fynn Godau	e98bff8ae9	Improved Bandcamp radio stream extractor tests	2020-06-04 12:30:53 +02:00
Fynn Godau	8f6c00f8d8	Use default test in BandcampSearchExtractorTest	2020-06-04 12:12:20 +02:00
Fynn Godau	de776561b0	Bandcamp: fix loading uploader from streams in search	2020-06-04 12:02:18 +02:00
Fynn Godau	3940138fc5	Fix Bandcamp capitalization in one more spot	2020-06-03 22:41:27 +02:00
Fynn Godau	9fa9d920a9	Bandcamp: Implement new methods required due to interface changes	2020-06-03 21:35:11 +02:00
Fynn Godau	dd955c7f0c	Merge branch 'origin/dev' into dev	2020-06-03 21:13:40 +02:00
wb9688	33b1121fc7	Add tests for parseDurationString()	2020-05-30 17:20:54 +02:00
wb9688	e39147202c	Fix YouTube video duration parsing	2020-05-30 09:31:08 +02:00
wb9688	98055a3c3c	Revert "Add more decryption function regexes" ... This reverts commit 384d6acd5d.	2020-05-29 18:41:40 +02:00
Tobias Groza	bdb0f2ae6b	Merge pull request #332 from wb9688/learning-playlist ... Support YouTube's learning playlists	2020-05-29 10:11:08 +02:00
Tobias Groza	cf18cdb2f5	Merge pull request #329 from wb9688/decryption-regexes ... Add more decryption function regexes	2020-05-29 10:10:50 +02:00
wb9688	ab77961b0a	Extract trailer thumbnail in YT learning playlists	2020-05-29 09:55:24 +02:00
wb9688	4d683e7655	Support YouTube's learning playlists	2020-05-29 09:17:03 +02:00
Tobias Groza	0b4977bb0c	Merge pull request #333 from wb9688/playerresponse-dashmanifesturl ... Extract dashManifestUrl in playerResponse	2020-05-28 21:17:07 +02:00
wb9688	384d6acd5d	Add more decryption function regexes	2020-05-28 11:40:38 +02:00
wb9688	8f71bde776	Fix bug for YT videos longer than 1000h	2020-05-28 11:34:42 +02:00
wb9688	aa277e1b6a	Upgrade other dependencies	2020-05-28 11:34:42 +02:00
wb9688	036cc7e26e	Upgrade jsoup	2020-05-28 11:34:41 +02:00
Fynn Godau	89b0639faa	New Bandcamp tests for channel extractor	2020-05-25 20:22:23 +02:00
Fynn Godau	e08256ebc6	Remove "url cleanup" in Bandcamp link handlers	2020-05-25 19:17:27 +02:00
Fynn Godau	692b2d06f4	Bandcamp: read info item data in place and not in advance	2020-05-25 18:53:15 +02:00
Fynn Godau	fff21caa87	Fix Bandcamp no avatar test ... I own the bandcamp artist account called "NewPipeExtractorTest", so it shouldn't break again.	2020-05-25 18:53:10 +02:00
wb9688	7ef3e80493	Extract dashManifestUrl in playerResponse	2020-05-15 12:07:26 +02:00
wb9688	efafbbb88a	Merge pull request #331 from wb9688/playlist-subchannel ... Add sub-channel stuff to PlaylistInfo	2020-05-12 10:49:13 +02:00
wb9688	baf5dd3e8f	Merge pull request #311 from B0pol/fixSearchSuggestion ... Search: add isCorrectedSearch() and fix YoutubeSearchExtractor#getSea…	2020-05-12 09:29:15 +02:00
wb9688	102f04e297	Add sub-channel stuff to PlaylistInfo	2020-05-12 09:14:29 +02:00
Tobias Groza	b40ccb5075	Merge pull request #307 from B0pol/playlists_peertube ... [PeerTube] playlist support	2020-05-11 20:53:03 +02:00
bopol	adaf196c99	remove unused import	2020-05-11 12:54:33 +02:00
bopol	de26e00079	changed all == null || isEmpty() to isNullOrEmpty()	2020-05-11 11:40:24 +02:00
bopol	202a73516c	refactor: add Utils.isNullOrEmpty()	2020-05-11 11:26:18 +02:00
wb9688	1de0876fb4	Fix #327	2020-05-09 20:06:50 +02:00
bopol	7cae95bf09	add tests for subchannel stuff in playlists	2020-05-09 10:15:35 +02:00
bopol	1a6e92ebf6	add getSubChannel Name, Url and AvatarUrl for playlists	2020-05-09 09:52:24 +02:00
bopol	cf99107745	address yausername change	2020-05-09 00:52:04 +02:00
bopol	5bab9d9fc0	[PeerTube] playlist support & refactoring	2020-05-09 00:52:04 +02:00
Tobias Groza	f3913e241e	Merge pull request #324 from Stypox/music-detector-url ... [YouTube] Support stream urls in `vnd.youtube://ID` form	2020-05-08 17:43:04 +02:00
wb9688	7320108c66	Rename SubChannel in channels back to ParentChannel	2020-05-08 16:02:59 +02:00
Roy Yosef	a408661771	Fix PR review ... Rename "ParentChannel" to "SubChannel" Add Tests for sub-channel info fetching	2020-05-07 20:20:12 +02:00
Roy Yosef	1de1f97cf1	Add parent channel info to StreamExtractor: name, url & avatar url	2020-05-07 20:20:12 +02:00
Roy Yosef	4234740baa	Add parent channel info to ChannelExtractor: name, url & avatar url	2020-05-07 20:20:12 +02:00
bopol	6cff5de400	renaming methods for consistency	2020-05-07 15:40:41 +02:00
bopol	5760366d70	use JsonObject#isEmpty instead of JsonObject#equals(JsonUtils.EMPTY_OBJECT)	2020-05-07 15:40:41 +02:00
bopol	93e868634e	clarified javadoc for isCorrectedSearch and getSearchSuggestions in SearchExtractor	2020-05-07 15:40:41 +02:00
bopol	3757541a9c	adapt new nanojson version	2020-05-07 15:40:41 +02:00
bopol	79483a6dc0	«Use this in SearchInfo, for consistency's sake» @Stypox order xD	2020-05-07 15:40:41 +02:00
bopol	e8d58e09c9	getSearchSuggestion now returns the corrected query if isCorrectedSearch() is true	2020-05-07 15:40:41 +02:00
bopol	5d1c3b3fa2	Use setters in SearchInfo	2020-05-07 15:39:57 +02:00
bopol	29b639b454	Search: add isCorrectedSearch() and fix YoutubeSearchExtractor#getSearchSuggestion() ... isCorrectedSearch: see the javadoc getSearchSuggestion: in YoutubeSearchExtractor, it was giving the corrected search query. It now gives the suggested query, as it should	2020-05-07 15:39:57 +02:00
Stypox	a02bfbeae5	[YouTube] Support stream urls in vnd.youtube://ID form	2020-05-07 15:31:31 +02:00
bopol	bc13e0c616	Merge remote-tracking branch 'upstream/dev' into soundcloudComments	2020-05-05 14:49:21 +02:00
wb9688	6aae99f832	Fix NPE in defaultAlertsCheck()	2020-05-03 10:28:45 +02:00
wb9688	a1eabc7589	Return null instead of "" in getTextFromObject()	2020-05-02 08:02:25 +02:00
Fynn Godau	e7b046db9d	Merge remote-tracking branch 'origin/dev' into dev	2020-04-26 23:12:43 +02:00
Fynn Godau	a3e8e1c70e	Bandcamp: move own methods to helper class	2020-04-26 23:05:56 +02:00
Fynn Godau	9bc7a470ab	Replace fori with foreach loop	2020-04-26 23:02:14 +02:00
Tobias Groza	49157fcf0d	Merge pull request #317 from wb9688/tnp-nanojson ... Use our fork of nanojson	2020-04-24 21:54:35 +02:00
bopol	2564bcf399	refactor comments ... rename methods in CommentsInfoItemExtractor interface to match the other method names across NewPipeExtractor remove getName in (Youtube|SoundCloud|Peertube)CommentsExtractor and move it up in CommentsExtractor, return "Comments" instead	2020-04-21 20:05:54 +02:00
Fynn Godau	f71bd29d58	Bandcamp playlist extractor: add more tests	2020-04-20 23:52:12 +02:00
Fynn Godau	5009d9f53b	Bandcamp tests: remove certain tests	2020-04-20 23:25:00 +02:00
Fynn Godau	b5e251c82f	Bandcamp channel extractor: package-private access for getImageUrl(…)	2020-04-20 23:12:43 +02:00
Fynn Godau	8c70dab8c5	Bandcamp search query handler factory: inline variable	2020-04-20 23:11:16 +02:00
Fynn Godau	10ae3db118	Bandcamp javadoc: Replace br tags with p tags	2020-04-20 23:03:12 +02:00
Fynn Godau	9201e0d3ea	Don't declare exceptions that can't actually be thrown	2020-04-20 22:46:54 +02:00
Fynn Godau	965bce00cf	Bandcamp stream extractor: return NO_AGE_LIMIT	2020-04-20 22:44:45 +02:00
Fynn Godau	82099592c7	Bandcamp: Move code from SearchExtractor to InfoItemExtractors	2020-04-20 22:44:35 +02:00
Fynn Godau	00c0333059	Bandcamp: Fetch channelInfo in onFetchPage	2020-04-20 22:41:44 +02:00
Fynn Godau	67de0285e1	Bandcamp: Generate query JSON in a proper way	2020-04-20 22:03:29 +02:00
Fynn Godau	c133190c53	Bandcamp capitalization	2020-04-20 21:55:35 +02:00
Fynn Godau	b100b9873f	Bandcmap: Use nanojson fork instead of org.json	2020-04-20 21:53:04 +02:00
wb9688	b51699a20e	Implement @TobiGr's suggestions	2020-04-20 14:27:33 +02:00
wb9688	74f0ab1792	Merge pull request #301 from wb9688/media-ccc-non-api-urls ... Use media.ccc.de instead of api.media.ccc.de	2020-04-19 17:06:57 +02:00
Fynn Godau	9c239371f4	Change nanojson dependency to @wb9688's fork	2020-04-19 14:29:39 +02:00
Fynn Godau	5c0a03328a	Merge 'origin/dev' into dev	2020-04-19 14:26:51 +02:00
bopol	0cbbc2a1f9	remove unused import	2020-04-19 14:16:38 +02:00
wb9688	979c5a7502	Use our fork of nanojson	2020-04-17 19:36:42 +02:00
bopol	d4352f9b84	support comments for SoundCloud	2020-04-10 20:41:41 +02:00
Roy Yosef	4afe657f6f	Add tests for getUrlFromId and test for video-channels in acceptUrlTest	2020-04-10 19:05:38 +03:00
Roy Yosef	2c9f1260eb	Fix wb9688 review comments ... * Rename PeertubeUserExtractor to PeertubeAccountExtractor * Add test for video-channels in PeertubeChannelLinkHandlerFactoryTest * Compatibility support for older versions (use "accounts/" as default)	2020-04-10 16:40:53 +03:00
bopol	636c430743	refactor: create extractors and linkHandler packages for SoundCloud, move YoutubeParsingHelper to youtube package (not linkhandler anymore)	2020-04-10 10:51:05 +02:00
Roy Yosef	b6e6f403a8	add support for PeerTube channels extraction	2020-04-09 20:37:49 +03:00
bopol	a20d53dd98	remove the mention of Opus on wb9688 advise when ... ContentNotSupportedException is thrown	2020-04-08 15:31:11 +02:00
bopol	9a7c6b7ab0	use ContentNotSupportedException for channels without tabs	2020-04-07 14:33:43 +02:00
bopol	a22104cbda	add tests for ContentNotSupportedException	2020-04-07 14:33:43 +02:00
bopol	093762e793	throw ContentNotSupportedException when content is know to be unsupported	2020-04-07 14:33:43 +02:00
Tobias Groza	094b87c537	Merge pull request #299 from B0pol/sc_countries ... add supported countries for soundcloud	2020-04-03 19:12:33 +02:00
wb9688	bce27a0e22	Rename getValidResponseBody() to getValidJsonResponseBody()	2020-04-03 17:23:18 +02:00
bopol	1eb3deb7fd	add supported countries for soundcloud	2020-04-02 11:26:19 +02:00
wb9688	8a9e137385	Extract some code to getValidResponseBody()	2020-04-01 16:01:21 +02:00
wb9688	bf24caa5f2	Use media.ccc.de instead of api.media.ccc.de	2020-04-01 13:25:10 +02:00
wb9688	2af610e3e7	Add tests for other YT Music search types	2020-04-01 10:30:51 +02:00
wb9688	c7f7bd2442	Fix error when YT Music videos has no uploader URL	2020-04-01 10:30:51 +02:00
wb9688	ac15df4548	Move YouTube Music search to its own class	2020-04-01 10:30:51 +02:00
wb9688	cf0f2aff3e	Extract uploader url from certain YouTube Music videos	2020-04-01 10:30:51 +02:00
wb9688	aa8cea47f3	Refactor YouTube Music search tests	2020-04-01 10:30:51 +02:00
wb9688	dd434cca01	Fix issue when there is no didYouMeanRenderer in itemSectionRenderer	2020-04-01 10:30:51 +02:00
wb9688	5a775a4bbe	Use new way of specifying stream count	2020-04-01 10:30:51 +02:00
wb9688	d58c0f230d	Improve code for YouTube Music search	2020-04-01 10:30:51 +02:00
wb9688	dc29d87962	Extract YouTube search suggestions	2020-04-01 10:30:51 +02:00
wb9688	c852b13d5a	Add Referer header so that it also works with HttpsUrlConnection	2020-04-01 10:30:51 +02:00
wb9688	eb48524411	Add tests for YouTube Music search	2020-04-01 10:30:51 +02:00
wb9688	2b9b2a78e8	Handle 100+ items in playlist	2020-04-01 10:30:51 +02:00
wb9688	fb9b9691b7	Improve getYoutubeMusicKeys()	2020-04-01 10:30:51 +02:00
wb9688	4ddbdf0aee	Disable artist search for now	2020-04-01 10:30:51 +02:00
wb9688	1762a527c9	Add support for YouTube Music search	2020-04-01 10:30:51 +02:00
Tobias Groza	69e0624e35	Merge pull request #298 from B0pol/feed_peertube ... [peertube] add feed url in channels	2020-03-28 12:53:47 +01:00
bopol	0ae53c1e50	[peertube] adapt test for channel feed url	2020-03-28 11:48:24 +01:00
bopol	bc43f8977d	[peertube] add feed url in channels	2020-03-28 10:22:47 +01:00
TobiGr	647e7cd450	Accept YouTube Music playlists but not YouTube Mixes	2020-03-25 22:24:18 +01:00
wb9688	bcd2a1092b	Don't accept YouTube Mix playlists	2020-03-25 11:07:28 +01:00
Tobias Groza	e4874d554e	Merge pull request #296 from mauriciocolli/fix-search-errors-detection ... Fix search errors detection and refactor search tests	2020-03-24 21:53:32 +01:00
Tobias Groza	8a9ae32e6b	Merge pull request #292 from wb9688/fix-yt-no-views ... Fix YouTube videos with no views	2020-03-24 20:27:08 +01:00
Mauricio Colli	0a20c53f1a	Use easier-to-read asserts statements in tests	2020-03-23 18:08:59 -03:00
Mauricio Colli	c921e5d6a5	Remove unnecessary collector creation function from search extractor	2020-03-23 18:08:51 -03:00
Tobias Groza	6fd9b38ad9	Merge pull request #287 from mauriciocolli/fix-channel-redirect ... [YouTube] Fix channel with redirects directly in the response	2020-03-23 18:41:56 +01:00
Mauricio Colli	04bfa0ec6a	[PeerTube] Update video used in age limit test (was 404 not found)	2020-03-21 15:55:40 -03:00
Mauricio Colli	921bf30bb7	[YouTube] Add check for channel items with no video count in search	2020-03-21 15:55:39 -03:00
Mauricio Colli	b7f8001a49	[YouTube] Add check for channel items without description in search	2020-03-21 15:55:38 -03:00
Mauricio Colli	9b7999fe54	[YouTube] Check if channel item has subscription count in search	2020-03-21 15:55:37 -03:00
Mauricio Colli	9704fc9952	Improve search extractor tests for services	2020-03-21 15:55:36 -03:00
Mauricio Colli	d72130edae	Always return a new item collector in the search extractor	2020-03-21 15:55:34 -03:00
Mauricio Colli	0c27198ba1	Include errors from child collectors in the search collector	2020-03-21 15:55:29 -03:00
TobiGr	2cf8cbf0df	Merge branch 'master' into dev	2020-03-18 22:29:10 +01:00
wb9688	222d659d9e	[SoundCloud] Don't make separate request for getAudioStreams() in StreamExtractor ... Signed-off-by: Stypox <stypox@pm.me>	2020-03-18 11:30:15 +01:00
wb9688	904c9d681f	Fix YouTube videos with no views	2020-03-18 10:07:49 +01:00
Stypox	265cfb61f3	[SoundCloud] Add test for small playlist, use defaultTestGetPageInNewExtractor	2020-03-17 21:03:50 +01:00
Stypox	45bb646480	[SoundCloud] Do not overwrite nextPageUrl in PlaylistExtractor ... Consistent with YouTube and the documentation	2020-03-17 20:56:47 +01:00
Fynn Godau	a1523eb293	Update Bandcamp service to latest interface changes	2020-03-17 20:40:25 +01:00
Stypox	c505d4e2b7	[SoundCloud] Remove trailing , in playlist page urls	2020-03-17 20:36:59 +01:00
Stypox	ae47c9587c	[SoundCloud] Optimize imports in edited files	2020-03-17 20:32:04 +01:00
Stypox	4389fd3b7b	[SoundCloud] Migrate StreamExtractor to api-v2	2020-03-17 18:06:13 +01:00
Stypox	5e4ddb368f	[SoundCloud] Fix extractors built from next playlist pages ... They didn't have the information to calculate another next page url. So now `nextPageUrl` contains a full link with all video ids, and `getPage` takes the first part of the url (containing 15 streams) and produces another `nextPageUrl` with the remaining streams. Also add a test for this.	2020-03-17 18:04:40 +01:00
fynngodau	b78f788017	Merge branch 'dev' into dev	2020-03-17 18:03:14 +01:00
Stypox	0e1b4bbf17	[SoundCloud] Test playlists banner: it should not exist	2020-03-17 15:53:25 +01:00
Stypox	65bdb3bc9d	[SoundCloud] Unignore ignored playlist tests	2020-03-17 15:49:58 +01:00
Stypox	1558da6f6b	[SoundCloud] Fix playlist next page generation	2020-03-17 15:46:35 +01:00
Stypox	ca8bf53b61	[SoundCloud] Fix playlist test: number of streams changed	2020-03-17 15:35:33 +01:00
Stypox	d4aa4a0763	[SoundCloud] Fix typo in ChartsExtractor	2020-03-17 15:25:11 +01:00
Stypox	4b1121aac7	[SoundCloud] Add tests for api-v2 channel urls	2020-03-17 15:23:13 +01:00
Stypox	c3d811fde5	[SoundCloud] Use api-v2 in SubscriptionExtractor ... Also added	2020-03-17 15:22:25 +01:00
Stypox	d0e66cc600	[SoundCloud] Improve thumbnail url extraction in playlists ... Prevent NullPointerExceptions and remove duplicate code	2020-03-17 15:13:28 +01:00
Stypox	f3095713f9	[SoundCloud] Use api-v2 in PlaylistExtractor ... Rewrote methods to calculate next page url and to get items from it. `api-v2` is different from `api` since the initial playlist page contains (usually) the full info of the first 3 streams and only the id of the other. Then the single tracks can be requested in batch using `/tracks?ids=id1,id2,...`.	2020-03-17 15:12:13 +01:00
TobiGr	9eca7df947	Forget to fetch the page	2020-03-16 20:50:08 +01:00
TobiGr	edb57840d7	[SoundCloud] Update hard-coded client_id	2020-03-16 19:43:36 +01:00
TobiGr	efad0be99f	Test if the extractor can get AudiStreams with the hard-coded cliend_id ... SoundCloud client_id are changed on a regular basis now. We might want to remove the hardcoded id completely on a later point of time when client_id is changed to often	2020-03-16 19:42:35 +01:00
TobiGr	5f39bc4e99	[SoundCloud] Update hardcoded client id	2020-03-16 17:26:30 +01:00
Tobias Groza	65a7eda446	Merge pull request #256 from B0pol/mediaccc ... Support for non-api mediaccc links, invidious shortened links, refactor mediaccc tests	2020-03-15 17:04:09 +01:00
TobiGr	40b3bc138f	Remove hack to fix YoutubeStreamLinkHandlerFactoryTest of vnd.youtube videos	2020-03-14 21:54:54 +01:00
Tobias Groza	1c954fbded	Merge pull request #277 from XiangRongLin/vnd ... Handle youtube stream urls in "vnd.youtube:videoId" format.	2020-03-14 21:52:49 +01:00
Tobias Groza	9edd0f2675	Merge pull request #288 from Stypox/fix-unlisted-video ... [YouTube] Fix videos without next stream throwing error and add test for unlisted videos	2020-03-14 21:36:13 +01:00
Stypox	957b78ed9b	[YouTube] Add test for an unlisted video, which has no next stream	2020-03-14 14:04:01 +01:00
Stypox	325a51f73a	[YouTube] Do not crash if there is no next stream, but return null ... Like every other extractor does if there is no next stream	2020-03-14 14:02:48 +01:00
TobiGr	aea0962cfe	[SoundCloud] Update hardcoded client id	2020-03-14 12:41:44 +01:00
Mauricio Colli	b086e9db3f	[YouTube] Fix id extraction for some channels ... Some channels had no reliable way to get the redirected id in the response, so saving it for later was a valid alternative.	2020-03-14 02:39:49 -03:00
Mauricio Colli	00d1ed439b	[YouTube] Fix channel extraction when redirects are in the response ... Some redirects were embed directly into the response as instructions for the page, instead of the usual http redirects.	2020-03-14 02:39:48 -03:00
bopol	66518ec444	check wether mediaccc streams url are secure	2020-03-13 20:07:36 +01:00
bopol	0cd5e05b7b	MediaCCCLH: use substring instead of replace; improve a bit tests, return Collections.emptyList(); instead of null where it's annotated @NonNull	2020-03-13 20:00:49 +01:00
bopol	f742a6bd3e	code optimization	2020-03-13 20:00:49 +01:00
bopol	9701c7d800	invidious shortened links	2020-03-13 20:00:49 +01:00
bopol	e8e535b815	mediaccc: update linkhandlers & refactor tests	2020-03-13 20:00:49 +01:00
Mauricio Colli	70abd57852	[YouTube] Cache commonly used stream type result	2020-03-07 16:48:32 -03:00
Mauricio Colli	1ef706f567	[YouTube] Detect LIVE videos in the trending page	2020-03-07 16:48:31 -03:00
Xiang Rong Lin	cc8fb486ee	Handle youtube stream urls in "vnd.youtube:videoId" format. ... The official YouTube app accept intents in this format, which causes other developers to use it.	2020-03-02 20:40:33 +01:00
Mauricio Colli	6aa4d59b91	[PeerTube] Update video used in age limit test (the previous was 404)	2020-03-01 10:29:30 -03:00
Mauricio Colli	cfc278317d	[YouTube] Fail-fast if status exist and is anything other than "OK"	2020-03-01 10:29:29 -03:00
Mauricio Colli	90ae5fbea2	Improve kiosk tests across services	2020-03-01 12:57:18 +01:00
Mauricio Colli	e590417cc4	Test if services recognizes their own items urls	2020-03-01 12:57:18 +01:00
TobiGr	35252235b0	Go through all badges when checking if a StreamInfoItem is a live stream	2020-03-01 12:52:37 +01:00
Mauricio Colli	5686a6f562	[YouTube] Detect when a stream is deleted or doesn't exist ... Added a test case as well.	2020-03-01 12:49:13 +01:00
Mauricio Colli	e65333c3ce	[YouTube] Detect deleted/nonexistent/invalid channels and playlists ... - Added tests for these cases.	2020-03-01 12:49:13 +01:00
Mauricio Colli	98e359438a	[YouTube] Detect simple 404s in the standard fetch method	2020-03-01 12:49:13 +01:00
Mauricio Colli	408f042127	[YouTube] Fix bug when url isn't present in the browseEndpoint object	2020-03-01 12:49:13 +01:00
Mauricio Colli	342bdbb852	[YouTube] Avoid crashing by letting exceptions bubble up	2020-03-01 12:49:13 +01:00
Mauricio Colli	e9644e6216	[YouTube] Handle video premiere's date and duration	2020-03-01 12:49:13 +01:00
Mauricio Colli	2a470ac4f7	[YouTube] Handle videos with no views or with "Recommended to you" text	2020-03-01 12:49:13 +01:00
Mauricio Colli	da2c562eb0	[YouTube] Take into account videos that have their views hidden ... Also remove catch because it may hide bugs when the page changes.	2020-03-01 12:49:13 +01:00
Mauricio Colli	f66c20de54	Ignore null-keyed entries when iterating through the response headers	2020-03-01 12:49:13 +01:00
Mauricio Colli	5edd774fc4	Add latest url to the response to make detection of a redirect possible ... Will be latest one in this commit because there's need to check the history of redirects as of now.	2020-03-01 12:49:13 +01:00
Mauricio Colli	3441946bea	Make test downloader return a response instead of throwing an exception ... The test implementation was throwing an exception instead of just returning the response and letting the caller handle it.	2020-03-01 12:49:13 +01:00
wb9688	df219a9453	Don't use StandardCharsets class	2020-03-01 09:41:06 +01:00
wb9688	2807079531	Catch NumberFormatException instead of checking whether viewCount equals "Recommended for you"	2020-02-29 21:28:38 +01:00
wb9688	3e4d2fd64e	Improve testChannelUrl()	2020-02-29 18:20:35 +01:00
wb9688	bfe3eb1409	Use suggested try-if code style	2020-02-29 17:18:50 +01:00
wb9688	a6a63e9570	Let isHardcodedClientVersionValid() throw IOException	2020-02-29 17:01:36 +01:00
wb9688	45df8248bf	Use Localization in getJsonResponse()	2020-02-29 16:55:07 +01:00
wb9688	157055fbfd	Create getJsonResponse() function	2020-02-29 16:42:04 +01:00
wb9688	4f406512c2	Use YoutubeChannelLinkHandlerFactory	2020-02-29 16:26:28 +01:00
wb9688	4ff655352d	Reimplement getAgeLimit()	2020-02-28 17:14:26 +01:00
wb9688	6ba03e542b	Cache getVideoTab()	2020-02-28 17:05:31 +01:00
wb9688	8bfbae904d	Cache getVideo(Primary|Secondary)InfoRenderer()	2020-02-28 17:03:21 +01:00
wb9688	0b940f5cf4	Use "getAgeLimit() != NO_AGE_LIMIT" instead of "getAgeLimit() == 18"	2020-02-28 16:40:50 +01:00
wb9688	beb07a4852	Add test to check whether hardcoded client version is still valid	2020-02-28 16:36:14 +01:00
wb9688	b89b6b1db2	Check if hard-coded client version is valid in separate function	2020-02-28 16:35:24 +01:00
wb9688	7898ba230d	Use pbj in YoutubeStreamExtractor	2020-02-28 15:17:47 +01:00
wb9688	612ec06839	Actually fix thumbnail URLs starting with //	2020-02-28 09:36:33 +01:00
wb9688	f946310af5	Fix search queries with a promotedSparklesTextSearchRenderer returning 0 results	2020-02-28 08:57:44 +01:00
wb9688	94a2d5be46	Fix thumbnail URLs starting with //	2020-02-27 19:08:46 +01:00
wb9688	838d834ce2	Get Uploads view of Videos tab	2020-02-27 18:54:27 +01:00
wb9688	365b0329f3	Implement getTextFromObject() function	2020-02-27 17:39:23 +01:00
wb9688	0798bdd5cd	Fix getSubscriberCount() for 0 subscribers	2020-02-27 16:26:22 +01:00
wb9688	8ebd971648	Fix channel descriptions consisting of multiple parts	2020-02-27 10:06:35 +01:00
wb9688	880b951088	Fix getUploaderAvatarUrl() in YoutubeStreamExtractor	2020-02-27 09:53:59 +01:00
wb9688	8aa560bef4	Fix video titles consisting of multiple parts due to @	2020-02-27 09:42:22 +01:00
wb9688	951ed9f0d8	Don't call getUploaderInfo() in onFetchPage() for playlists ... This way YouTube Music playlists will keep working in NewPipe	2020-02-27 09:27:56 +01:00
wb9688	2399d46ab0	Fix YoutubeChannelExtractor for channels without videos	2020-02-27 09:21:25 +01:00
wb9688	cdbc751b87	Fix getUploaderUrl() in YoutubeStreamInfoItemExtractor	2020-02-27 09:05:41 +01:00
wb9688	db305408e9	Get all expandedShelfContentsRenderers in YoutubeTrendingExtractor	2020-02-26 20:37:20 +01:00
wb9688	a2d8489e16	Parse timestamps in description	2020-02-26 20:27:30 +01:00
wb9688	8d503407ef	Parse browseEndpoint and watchEndpoint in descriptions	2020-02-26 19:37:58 +01:00
wb9688	8dc39d517a	Fix tests ... Except testGetFullLinksInDescription() in DescriptionTestUnboxing, since that requires other changes first.	2020-02-26 17:31:01 +01:00
wb9688	88282761f4	Fix YoutubeStreamExtractor not being able to getAgeLimit() in onFetchPage()	2020-02-26 16:19:42 +01:00
wb9688	bb3a3d70bf	Use pbj in YoutubeTrendingExtractor	2020-02-26 16:10:24 +01:00
wb9688	1c3a4e710b	Check if there are no related streams in getAgeLimit()	2020-02-26 16:03:06 +01:00
wb9688	985c3ec877	Improve getClientVersion()	2020-02-26 15:27:50 +01:00
wb9688	15afbea3e1	Use pbj in YoutubePlaylistExtractor	2020-02-26 15:27:50 +01:00
wb9688	89a41a7f69	Use pbj in YoutubeChannelExtractor	2020-02-26 15:27:50 +01:00
wb9688	0973263aab	Use pbj in YoutubeSearchExtractor	2020-02-26 15:27:46 +01:00
TobiGr	fc465c8bf7	Fix getUploadDate() for premiered videos with a given date ... Detect publishDate and uploadDate	2020-02-25 22:54:37 +01:00
TobiGr	96285e0815	Fix getUploadDate() for premiered videos with a given date	2020-02-25 21:51:30 +01:00
wb9688	5a35300a5e	Fix parsing upload date for premiered streams	2020-02-25 21:51:30 +01:00
wb9688	729fd2eaee	Fix parsing description for navigationEndpoint without urlEndpoint	2020-02-25 21:51:30 +01:00
wb9688	26fb44595f	Fix parsing description	2020-02-25 21:51:30 +01:00
TobiGr	0fff03038e	Get description with correct links	2020-02-25 21:51:30 +01:00
wb9688	5d08c34322	Fix parsing upload date in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	bbe1a3cd62	Use getVideo(Primary|Secondary)InfoRenderer()	2020-02-25 21:51:30 +01:00
wb9688	8e6be880d7	Simplify getId() in YoutubeChannelExtractor	2020-02-25 21:51:30 +01:00
TobiGr	ecfc27a92c	Implement fallback methods for getDescription() and getTextualUploadDate() in YouTubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	eed29ea734	Return null for related streams at age restricted videos	2020-02-25 21:51:30 +01:00
TobiGr	9efcc61ca6	Adapt some tests to match the new URLs	2020-02-25 21:51:30 +01:00
TobiGr	f39603f6ef	Implement getUploadDate() in YouTubeStreamInfoItemExtractor	2020-02-25 21:51:30 +01:00
wb9688	26ea3dceb6	Fix getViewCount() in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	76d54abdbf	Reimplement more methods in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	f13c0288cc	Reimplement some methods in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	02b59903fa	Remove useless code	2020-02-25 21:51:30 +01:00
TobiGr	dd4dd849dc	Get client version dynamically in YouTubeSearchExtractor	2020-02-25 21:51:30 +01:00
TobiGr	583e9c1571	Fix getPage() ... Someone should check if there are unstaged changes before committing...	2020-02-25 21:51:30 +01:00
TobiGr	5842b9ad37	Add getClientVersion() and HARDCODED_CLIENT_VERSION to YouTubeParsingHelper ... Prefer hardcoded client version above the current one when making requests to retrieve the same JSON structure for each request.	2020-02-25 21:51:30 +01:00
wb9688	5d883d100c	Implement pagination in YoutubeSearchExtractor	2020-02-25 21:51:30 +01:00
wb9688	c0a8e01889	Implement pagination in YoutubePlaylistExtractor	2020-02-25 21:51:30 +01:00
wb9688	4039409820	Fix getLikeCount() for certain streams	2020-02-25 21:51:30 +01:00
wb9688	627ab2459f	Uncomment fetchPage()	2020-02-25 21:51:30 +01:00
wb9688	2dfa2187ff	Implement pagination in YoutubeChannelExtractor	2020-02-25 21:51:30 +01:00
wb9688	a38ab9b791	Return null if channel has no banner	2020-02-25 21:51:30 +01:00
wb9688	1eca63089b	Count private and deleted videos as ad	2020-02-25 21:51:30 +01:00
wb9688	c7360e4a46	Fix getThumbnailUrl() in YoutubeChannelInfoItemExtractor	2020-02-25 21:51:30 +01:00
wb9688	51fb26625a	Implement getSubscriberCount() in YoutubeChannelInfoItemExtractor	2020-02-25 21:51:30 +01:00
TobiGr	6d20b2b1d0	Fix NPE on collecting page items	2020-02-25 21:51:30 +01:00
wb9688	4462cbe3f1	Reimplement YoutubePlaylistInfoItemExtractor	2020-02-25 21:51:30 +01:00
wb9688	8aea4d445b	Reimplement YoutubeChannelInfoItemExtractor	2020-02-25 21:51:30 +01:00
wb9688	3187116a63	Handle premium videos	2020-02-25 21:51:30 +01:00
wb9688	7442f91aa6	Don't assume which channel tab is videos	2020-02-25 21:51:30 +01:00
wb9688	316fe0109d	Fix first playlist page	2020-02-25 21:51:30 +01:00
wb9688	4e57e589ce	Fix first channel page	2020-02-25 21:51:30 +01:00
TobiGr	5816202cc7	Move getInitialData() method to YouTubeParsingHelper ... Rename ytInitialData to initialData	2020-02-25 21:51:30 +01:00
wb9688	38aabc6aca	Use plain YoutubeStreamInfoItemExtractor in YoutubeTrendingExtractor	2020-02-25 21:51:30 +01:00
wb9688	957db062ef	Fix getting uploader for videoRenderer	2020-02-25 21:51:30 +01:00
wb9688	b88188d419	Move stuff from extractVideoPreviewInfo() into YoutubeStreamInfoItemExtractor and partially fix search	2020-02-25 21:51:30 +01:00
wb9688	af49b3c487	Fix live streams in extractVideoPreviewInfo()	2020-02-25 21:51:30 +01:00
TobiGr	f33f9466ce	Fix testDescription() in ChannelExtractor	2020-02-25 21:51:30 +01:00
TobiGr	10e9c16d8c	Fix LiveStream view count	2020-02-25 21:51:30 +01:00
wb9688	127c4d5893	Fix getNextStream() in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	7bfc0e62c6	Fix getRelatedStreams() in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
TobiGr	12166ca60c	[StreamExtractor] Add fallback method for uploader avatar url	2020-02-25 21:51:30 +01:00
wb9688	3ec422a542	Fix like/dislike parsing	2020-02-25 21:51:30 +01:00
TobiGr	a34e5c18e1	Trending StreamInfoItemCollecetor	2020-02-25 21:51:30 +01:00
TobiGr	b705515da0	Adapt most playlist fields	2020-02-25 21:51:30 +01:00
TobiGr	21253abd9b	Use Firefox ESR User-Agent: 68	2020-02-25 21:51:30 +01:00
TobiGr	655c999795	Detect disabled subriber count correctly ... Fix parsing of kiosk name	2020-02-25 21:51:30 +01:00
TobiGr	7dcc9f159b	Stream: fix uploader avatar url	2020-02-25 21:51:30 +01:00
TobiGr	be3e20e263	Adapt most channel changes	2020-02-25 21:51:30 +01:00
TobiGr	39bf1ff1eb	Add ytInitialData regex	2020-02-25 21:51:30 +01:00
Tobias Groza	a129c65c63	more improvements of comments ... Co-Authored-By: Stypox <stypox@pm.me>	2020-02-16 23:59:31 +01:00
TobiGr	0a4115286b	Apply one suggestion	2020-02-15 13:36:54 +01:00
Tobias Groza	6822574588	Fix typos ... Co-Authored-By: B0pol <bopol@e.email>	2020-02-15 13:36:54 +01:00
TobiGr	030465b5d4	Improve code formatting and optimise imports	2020-02-15 13:36:54 +01:00
TobiGr	9112a106ea	[SoundCloud] Update client_id	2020-02-08 23:09:03 +01:00
TobiGr	008b6f505c	[PeerTube] Fix subscriber count in ChannelExtractorTest	2020-02-08 23:08:37 +01:00
TobiGr	0e33249c85	Fix SoundCloud description test	2020-02-08 22:20:20 +01:00
Fynn Godau	36a316eea5	Merge branch 'dev' into dev	2020-02-08 09:43:13 +01:00
bopol	11bcc78d9c	Description implements Serializable. fix NotSerializableException	2020-02-07 14:10:54 +01:00
bopol	0f8a7f9df2	fix testGetUploadDate for PeerTubeStreamExtractor	2020-02-07 13:33:50 +01:00
bopol	70a40e7388	Description: rm constructor by serviceId	2020-02-07 13:28:27 +01:00
bopol	26c65b2948	Create class Description	2020-02-06 23:35:46 +01:00
bopol	5756df8dc7	Use GMT as base time (actually fix upload date)	2020-02-06 22:33:48 +01:00
B0pol	b671a4ba18	Merge branch 'dev' into peertube	2020-02-01 18:18:23 +00:00
Mauricio Colli	26234a1c0f	Introduce FeedExtractor making fetching from dedicated feeds possible ... YouTube, for example, has a dedicated feed which was built to be used like this.	2020-01-28 02:44:18 -03:00
Mauricio Colli	be81f2945c	[YouTube] Use correct upload date flag in StreamExtractor	2020-01-28 02:44:17 -03:00
Mauricio Colli	5c0c35064c	Use clean url and id when creating a channel info	2020-01-28 02:44:16 -03:00
TobiGr	033a9fb8e3	Revert change which I accidentally committed while fixing the decryption ... function in 7b72fd2a7d	2020-01-25 21:08:17 +01:00
B0pol	e392b6c68f	getLanguageInfo returns Locale instead of String ... so that java can automatically translate with Locale.getDisplayLanguage(), instead of always having English name of the language	2020-01-25 14:12:38 +01:00
B0pol	341372c0d0	reindenting (ctrl alt l) on JsonUtils and PeertubeStreamExtractor	2020-01-24 20:16:24 +01:00
B0pol	b816e48216	Merge branch 'dev' into peertube	2020-01-24 20:10:47 +01:00
TobiGr	f8d117f6cd	Merge remote-tracking branch 'origin/master' into dev	2020-01-24 19:22:40 +01:00
TobiGr	7b72fd2a7d	[YouTube] Add new decryption function	2020-01-24 02:10:56 +01:00
TobiGr	bce87f3d01	Improve getDescriptionFuncName by removing catches and adding a loop	2020-01-24 02:10:38 +01:00
TobiGr	9b45c61103	Typos, comments and formatting	2020-01-24 02:10:18 +01:00
TobiGr	29a4cc78bf	Fix typo in decryption constant	2020-01-24 02:10:08 +01:00
B0pol	812c8e0ad2	authorName in comments now follow PeerTube website ... https://peertube.cpy.re/videos/watch/d2a5ec78-5f85-4090-8ec5-dc1102e022ea anonyme zirbeldrüse is his displayName, what was displayed in NewPipe. but on the website, it's shown 777@mastodon.xyz	2020-01-24 00:22:05 +01:00
bopol	c790261eed	update test	2020-01-23 19:08:41 +01:00
bopol	a691d6d0fc	fix upload date: there was a one hour delay ... on peertube.co.uk: https://i.imgur.com/8Pai1rb.png on newpipe, before this commit: https://i.imgur.com/NIRbs4Z.png on newpipe, with this commit: https://i.ibb.co/mhKKtRD/Screenshot-20200123-185422-New-Pipe-Debug.png	2020-01-23 19:02:40 +01:00
bopol	20da4750f8	empty support returns "", same for empty description	2020-01-23 14:37:14 +01:00
bopol	74439f692a	add extraction for support info and rename getLanguageInfo function	2020-01-23 14:19:22 +01:00
B0pol	1a15c0e750	agelimit now returns 18 if the video is marked as nsfw, 0 otherwise ... + created getBoolean method in JsonUtils.java	2020-01-23 04:42:54 +01:00
B0pol	bcfe7be4e6	Merge branch 'dev' into peertube	2020-01-22 19:19:41 +01:00
Tobias Groza	b9afc9807c	Merge pull request #233 from Stypox/yt-stream-ext ... Youtube stream extractor improvements by using playerResponse json	2020-01-20 23:17:36 +01:00
Stypox	1cfdc4547a	Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/extractors/YoutubeStreamExtractor.java ... Co-Authored-By: Tobias Groza <TobiGr@users.noreply.github.com>	2020-01-20 22:52:48 +01:00
Stypox	1e1100ef76	Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/extractors/YoutubeStreamExtractor.java ... Co-Authored-By: Tobias Groza <TobiGr@users.noreply.github.com>	2020-01-20 22:52:36 +01:00
TobiGr	2308b074f0	[MediaCCC] Fix testGetTextualUploadDate()	2020-01-20 22:12:39 +01:00
TobiGr	089dbe8afb	Fix StreamLinkHandlerFactoryTest by passing baseUrl to vdn.youtube urls	2020-01-20 22:10:18 +01:00
B0pol	f403490bd9	Refactoring ... Co-Authored-By: Tobias Groza <TobiGr@users.noreply.github.com>	2020-01-20 21:28:26 +01:00
TobiGr	69ccb7e69d	Update subtitle tests comments	2020-01-20 21:25:47 +01:00
TobiGr	7943130307	Throw IllegalArgumentException when url is null in LinkHandlerFactory	2020-01-20 21:25:16 +01:00
TobiGr	39de55dcd3	[YouTube] Fix and move streamCountTest	2020-01-20 21:24:51 +01:00
bopol	ad7f97ae83	fix PeerTube description and add more description tests ... actually, the max description length is 250 after request with our extractor. during my tests, I made API requests with Firefox, copy/pasted into echo "insert description" | wc, and it was giving a wrong length, maybe due to the escapers, I have no idea anyway, it's now fixed	2020-01-20 15:14:23 +01:00
bopol	b382416372	changed the way to extract peertube description ... if the description length is above 254, and ends with ..., it means the description we got from the first request is shortened. why above 254: because in fact, shortened descriptions length are between 255 : https://framatube.org/videos/watch/24efbe1b-73c0-4d72-a3ff-77c8b32d3fcd https://framatube.org/videos/watch/1ca99f40-fb5b-4fa4-abe5-4d54325df7fc and 269: https://framatube.org/videos/watch/4d661d5f-a884-4510-bca8-15cb19aa3fe5 also fixed a typo in StreamExtractor.java	2020-01-20 14:36:12 +01:00
bopol	a281519e77	added metadata, fix descriptions, fix thumbnail, update tests ... thumbnail: quality before: https://peertube.cpy.re/static/thumbnails/d2a5ec78-5f85-4090-8ec5-dc1102e022ea.jpg quality after: https://peertube.cpy.re/static/previews/d2a5ec78-5f85-4090-8ec5-dc1102e022ea.jpg description: we were getting about the first 260 characters, we now get full description (with fallback to first 260 chars if the get request for full description fails) test: updated tests to match description, also changed some test: it was assertEquals(extracted, expected), but the proper way to do it is assertEquals(expected, extracted) metadata: got host, privacy (public, private, unlisted), licence, language, tags	2020-01-20 12:22:33 +01:00
Tobias Groza	2ee558fbe7	Merge pull request #237 from B0pol/fix_invidious_comments ... Fix invidious comments	2020-01-17 22:55:51 +01:00
Tobias Groza	5a259fca94	Merge pull request #238 from B0pol/c_links_support ... add support to /c/shortened_url channel links	2020-01-17 22:53:46 +01:00
Fynn Godau	623e6a8c63	Merge branch 'dev' into dev	2020-01-17 22:37:42 +01:00
bopol	221e8dd171	changed assertTrue(string.equals(string)) to assertEquals(string, string)	2020-01-17 21:24:52 +01:00
bopol	5e81ed1dff	add support to /c/shortened_url channel links	2020-01-17 19:27:54 +01:00
B0pol	7e8d00981f	changed getId() to remove duplicate code	2020-01-17 13:44:55 +01:00
B0pol	02930d08f1	added comments test for invidious	2020-01-17 12:58:50 +01:00
B0pol	a12c0e2a37	fix:invidious: getID and onAccpetURl for comments	2020-01-17 12:09:59 +01:00
B0pol	3743c60695	fix: typos in Test	2020-01-15 14:27:52 +01:00
Stypox	0567c20549	Merge branch 'dev' into yt-stream-ext	2020-01-07 00:10:06 +01:00
Stypox	7ba04836eb	Add tests for ratings in yt stream extractor tests	2020-01-06 23:57:08 +01:00
Stypox	1bb6cdee22	Enable commented-out test for yt stream extractor	2020-01-06 21:43:24 +01:00
Stypox	d5ca02f3f6	Fix test failing because music channel could be Vevo ... In yt stream extractor test. The Vevo and the normal music channel are equivalent, so Youtube picks one of them at random, and in playerResponse the channel id is Vevo's one.	2020-01-06 21:41:15 +01:00
Stypox	1689037b01	Fix getLength() tests now that the value is rounded (not floor-ed) ... In yt stream extractor	2020-01-06 20:49:08 +01:00
Stypox	1ed89aad3e	Use more often playerResponse in yt stream extractor ... This enhances performance and should make the extractor more reliable since it get info from a stable json structure that shouldn't be subject to many changes. Fallback html methods have been kept. In case of error the thrown exception contains the data about the playerResponse failure, that should be clearer than a NPE caused by not-found html tags.	2020-01-06 20:45:57 +01:00
Fynn Godau	ba967f1a15	Workaround enourmous load times for long bandcamp playlists ... Additionally, get cover art from json instead of html	2020-01-03 13:17:04 +01:00
Fynn Godau	46e1f3922c	Refuse to load bandcamp playlists without content	2020-01-03 12:32:22 +01:00
Fynn Godau	f0d36dfa7e	Bandcamp radio: proper name, date shortened	2020-01-03 12:28:49 +01:00
Fynn Godau	808c8aa087	Add bandcamp weekly kiosk ... Unfortunately a little messy	2020-01-03 12:28:49 +01:00
Fynn Godau	13ef11e9c8	Bandcamp featured kiosk	2020-01-03 12:28:49 +01:00
Fynn Godau	db02850d4f	Bandcamp playlist extractor: support playlists with just one stream	2020-01-03 12:28:49 +01:00
Fynn Godau	13e4908b83	Bandcamp search extractor: read track count from result page	2020-01-03 12:28:49 +01:00
Fynn Godau	9b16baffb7	Bandcamp search: multiple pages	2020-01-03 12:28:49 +01:00
Fynn Godau	ce2a88e56f	Add bandcamp search suggestion extractor	2020-01-03 12:28:49 +01:00
Fynn Godau	e12ddaef7f	Bandcamp playlist and search extractors: better and more tests	2020-01-03 12:28:49 +01:00
Fynn Godau	655df356a2	Various improvements concerning bandcamp playlists	2020-01-03 12:28:49 +01:00
Fynn Godau	ba700bfb3e	Add bandcamp playlists (albums)	2020-01-03 12:28:49 +01:00
Fynn Godau	d05b14ae48	Add channels (artists) to search results	2020-01-03 12:28:49 +01:00
Fynn Godau	794ca5eeae	Bandcamp channel extractor: handel nonexistent images better	2020-01-03 12:28:49 +01:00
Fynn Godau	91c0ec7cea	Bandcamp stream extractor: catch NullPointerException	2020-01-03 12:28:49 +01:00
Fynn Godau	d5cdc20be1	Bandcmap channel extractor: fix getting banner url	2020-01-03 12:28:49 +01:00
Fynn Godau	7730eb2ea1	Bandcamp channel extractor: enforce https when getting banner url	2020-01-03 12:28:49 +01:00
Fynn Godau	a42c77425d	Bandcamp channel extractor (ignoring everything but tracks)	2020-01-03 12:28:49 +01:00
Fynn Godau	5281456899	Bandcamp channel link handler factory	2020-01-03 12:28:49 +01:00
Fynn Godau	c3d127ccd9	Bandcamp audio stream test and fix	2020-01-03 12:28:49 +01:00
Fynn Godau	80d67e22b7	Return mp3-128 audio stream [experimental]	2020-01-03 12:28:49 +01:00
Fynn Godau	43dc3c3d4c	Return empty kiosk list instead of null	2020-01-03 12:28:49 +01:00
Fynn Godau	a579337c9a	Bandcamp service with support for streams and searches	2020-01-03 12:28:49 +01:00
pihug12	d4e0930f44	[Soundcloud] Update client_id	2019-12-31 23:36:23 +01:00
Tobias Groza	d83787a5ca	Merge pull request #226 from 7FM/dev ... fix switching on null causing NPE	2019-12-31 00:26:27 +01:00
TobiGr	0b6e37e71f	Improve YouTubeSearchPagingtest	2019-12-31 00:18:53 +01:00
Zsombor Gegesy	64729e5357	Improve the tests	2019-12-29 23:14:55 +01:00
Zsombor Gegesy	68b0fd9650	Add test for search paging	2019-12-29 23:14:55 +01:00
Zsombor Gegesy	2123b3abd3	Fix search result paging - due to the way as the InfoItemsSearchCollector are re-used, ... the returned item list just grows, which cause that same videos are returned.	2019-12-29 23:14:55 +01:00
Zsombor Gegesy	0a3422a591	Fix invalid jsoup query	2019-12-26 14:03:40 +01:00
7FM	fd5ed07d33	Merge branch 'dev' into dev	2019-12-22 12:33:26 +01:00
TobiGr	8e53fdad16	[SoundCloud] Fix getAudioStreams 401 response ... Fix TeamNewPipe/NewPipe#2823	2019-12-22 00:42:07 +01:00
7FM	f57d9d43ce	fix switching on null causing NPE	2019-12-21 14:15:42 +01:00
TobiGr	54d1a1a831	Fix SoundCloud client_id extraction and update SoundCloud client_id ... Don't throw exception when hard coded client_id is wrong. Addresses TeamNewPipe/NewPipe#2823	2019-12-12 18:01:48 +01:00
Redirion	035994b3cf	Update PlaylistInfo.java ... added missing imports	2019-12-09 16:55:28 +01:00
Redirion	e98112ea21	Update PlaylistInfo.java ... Fixed typo	2019-12-07 14:34:15 +01:00
Redirion	cdf41b868c	Allow PlayLists with missing uploader ... This supports PR 2724 in NewPipe	2019-12-07 12:49:42 +01:00
yausername	00c23683b1	Merge remote-tracking branch 'upstream/dev' into peertube	2019-12-03 00:45:03 +05:30
yausername	5115541268	fix peertube trending, added most-liked kiosk	2019-12-03 00:42:06 +05:30
kapodamy	c1d39f692d	Merge branch 'dev' into yt-webm-opus	2019-11-24 11:56:16 -03:00
yausername	6a7680ce17	added instance getter	2019-11-24 03:38:27 +05:30
yausername	281ccea39f	[peertube] constant name for service	2019-11-24 02:35:41 +05:30
yausername	bc75c6603b	added getBaseUrl method to linkhandler	2019-11-23 00:05:49 +05:30
yausername	279f175693	validate peertube instance	2019-11-22 22:59:14 +05:30
yausername	4e0adbefbc	[peertube] use baseUrl instead of global instance url	2019-11-21 05:35:22 +05:30
yausername	8a7aa6b9a9	added baseUrl param in linkhandlers. Required for multi instance services	2019-11-21 05:00:09 +05:30
yausername	f3a59a6cdc	merged upstream/dev	2019-11-20 03:08:17 +05:30
Mauricio Colli	0c6e2c8f23	Revert "Temp Commit: Ignore Test (Remove this before merge)" ... This reverts commit 6ca4c8986a.	2019-11-18 10:09:18 +01:00
yausername	318f600527	add subtitles support for peertube	2019-11-16 04:30:13 +05:30
yausername	bb5ad49fac	fix html comments	2019-11-16 03:20:35 +05:30
yausername	193442d01c	add original url for share	2019-11-16 02:42:39 +05:30
yausername	d7582734e7	merged upstream/dev	2019-11-16 00:07:45 +05:30
Mauricio Colli	3d21ef5dba	Introduce class that indicates when the time ago is an approximation	2019-11-03 15:46:28 -03:00
Mauricio Colli	6ca4c8986a	Temp Commit: Ignore Test (Remove this before merge)	2019-11-03 15:46:27 -03:00
Mauricio Colli	41b51adceb	[YouTube] Force english as the only supported language (#196)	2019-11-03 15:46:25 -03:00
Mauricio Colli	cb1e327a6e	[YouTube] Fix parsing of video reminders	2019-11-03 15:46:23 -03:00
Mauricio Colli	d8280ce0da	[YouTube] Parse watching count in live streams items	2019-11-03 15:46:22 -03:00
Mauricio Colli	3638f0e0ea	Implement time ago parser and improve localization handling ... - Handle special cases for languages where the number is not shown - Rework the Downloader base implementation, allowing for more advanced things to be done - Separate the localization from the content country (just like YouTube let's the user choose both).	2019-11-03 15:46:21 -03:00
wojcik-online	180836c180	Base Implementation: Parse the upload date of StreamInfoItems ... In the format '2 days ago' (in English) on a YouTube channel page. (Parser extensible to other pages.)	2019-11-03 15:46:20 -03:00
Mauricio Colli	c4fe2183ce	[YouTube] Improve detection of reCAPTCHA pages	2019-10-29 02:00:41 -03:00
Mauricio Colli	9a325b280d	[YouTube] Make detection of age restricted pages more reliable	2019-10-29 02:00:40 -03:00
Mauricio Colli	91c360df5e	Remove section of dead code	2019-10-29 02:00:39 -03:00
Mauricio Colli	ddd563fe78	[SoundCloud] Add test for hardcoded client id	2019-10-23 16:54:20 +02:00
Mauricio Colli	4fc18a6994	[SoundCloud] Fix extraction of client id ... - Hardcoded id and check at the first usage. - As a fallback, and considering that the scripts containing the client id were all split up, try searching it in each of them.	2019-10-23 16:54:20 +02:00
Mauricio Colli	250c0bb1e8	Add head request to the current downloader implementation	2019-10-23 16:54:20 +02:00
kapodamy	3c6e93c96a	Merge branch 'dev' into yt-webm-opus	2019-10-12 14:01:50 -03:00
Tobias Groza	06f2144e4d	[YouTube] Remove GEMA exception handling (#202)	2019-10-05 14:59:05 +02:00
kapodamy	95f93bc71c	Merge branch 'dev' into yt-webm-opus	2019-10-01 13:11:43 -03:00
Stypox	fbb9a86c9f	Merge branch 'dev' into yt-webm-opus	2019-09-29 18:16:14 +02:00
Vasiliy	d8279f91f6	Merge branch 'dev' of https://github.com/TeamNewPipe/NewPipeExtractor into feature/frames	2019-09-28 14:46:14 +03:00
TobiGr	8ab48c62b9	[YouTube] Fix NPE in ChennelExtractor.getSubsciberCount()	2019-09-25 08:57:08 +02:00
TobiGr	0710f31a39	Fix TeamNewPipe/NewPipeExtractor#197	2019-09-25 08:37:26 +02:00
Stypox	d1cd341592	Change comment	2019-09-25 08:32:00 +02:00
Stypox	f6088c4fc1	Add test for Eminem channel (it has no "Subscribe" button)	2019-09-25 08:32:00 +02:00
Stypox	35921345d9	Use Exception instead of Throwable (more consistent)	2019-09-25 08:32:00 +02:00
Stypox	db3596c818	Fix "Could not get id" for channels w/o "Subscribe" button	2019-09-25 08:32:00 +02:00
Stypox	94e7f0d3ab	Fix fallback method is not tried on exception ... in YoutubeChannelInfoItem.getUrl()	2019-09-25 08:32:00 +02:00
kapodamy	12008fc6bb	Update MediaFormat.java ... declare WEBMA_OPUS	2019-09-23 21:25:19 -03:00
kapodamy	5f3c2f5622	Update ItagItem.java	2019-09-23 21:25:19 -03:00
TobiGr	6d504e0883	Add test for mixedNumberWordToLong method ... Add Billion to mixedNumberWordToLong	2019-09-17 09:15:05 +02:00
TobiGr	06016d1ae3	Fix YouTube subscriber count ... Modify test to fail on too small subscriber count	2019-09-16 23:16:05 +02:00
Tobias Groza	dbdd9ed083	Merge pull request #195 from Stypox/livestream-fix ... Fix livestreams	2019-09-12 22:40:44 +02:00
toehead2001	b709529cb6	Add link handler tests for music.youtube.com	2019-09-12 12:16:30 -06:00
toehead2001	075e6d51d6	Add music.youtube.com to link handler	2019-09-12 12:16:30 -06:00
Stypox	1a1672248a	Eliminate Android Studio warnings in livestream test	2019-09-12 15:11:23 +02:00
Stypox	3f1ba93be5	Fix NPE when extracting itags with non-existing streamingData key	2019-09-12 15:08:17 +02:00
Stypox	0d8fb65003	Fix NPE on determining whether stream is live on Youtube	2019-09-12 15:07:07 +02:00
Stypox	4453a63447	Add test for YouTube livestreams ... The current livestream is https://www.youtube.com/watch?v=EcEMX-63PKY	2019-09-12 15:05:22 +02:00
Stypox	5f8e76eb87	Move stream-related youtube tests to subfolder	2019-09-12 14:36:42 +02:00
Tobias Groza	bfa6b4d14b	Merge pull request #182 from 2secslater/patch-1 ... Add Invidious instances	2019-09-12 09:19:11 +02:00
Tobias Groza	ec3554a2ea	Merge pull request #193 from Stypox/unavailable-video-fix ... Fix TeamNewPipe/NewPipe#2615	2019-09-11 21:44:05 +02:00
Stypox	24a37b88a9	Use pre-generated playerResponse field in yt's getHlsUrl() ... Also refactored code to always throw exception when the url can't be found	2019-09-11 20:12:30 +02:00
Stypox	9c423a0a40	Use FORMATS to get video+audio streams on yt ... Not ADAPTIVE_FORMATS	2019-09-11 20:04:28 +02:00
Stypox	e5e8c66686	Readd signature decryption in YtStreamExtractor	2019-09-11 19:56:16 +02:00
Stypox	d9570d8634	Use pre-generated playerResponse field everywhere in YtStreamExtractor	2019-09-11 19:35:08 +02:00
Stypox	63a37c48e3	Remove println left behind	2019-09-11 19:31:39 +02:00
Stypox	bf017bf5b9	Fix TeamNewPipe/NewPipe#2615	2019-09-11 19:05:41 +02:00
Vasiliy	ecb8ad85a1	Update comments	2019-09-11 19:03:53 +03:00
Andrew	d0f1c31b34	Add Invidious instances to parsing helper for YouTube	2019-09-10 17:54:32 +01:00
Vasiliy	b55c05d04f	Update frameset extractor test	2019-09-10 19:42:55 +03:00
Vasiliy	ab32b0ed84	Merge remote-tracking branch 'upstream/dev' into feature/frames	2019-09-10 19:39:58 +03:00
Vasiliy	f084cfec24	Refactor frames extraction	2019-09-10 19:38:51 +03:00
Tobias Groza	c7e9ad57c4	Merge branch 'dev' into patch-1	2019-09-09 19:05:00 +02:00
Zsombor Gegesy	93aeb19bbc	Fix 'java.lang.IllegalArgumentException: Did not find balanced marker at 'class*="yt-lockup-video"' ... at org.jsoup.helper.Validate.fail(Validate.java:110)'	2019-09-02 23:45:37 +02:00
Vasiliy	a6c94c7a9d	Grub frames preview from youtube	2019-08-26 19:14:09 +03:00
jimbo1qaz	e38d906ff9	Fix timestamp links in Youtube video descriptions ... For some reason, in NewPipeExtractor, comments were loaded from JSON by YoutubeCommentsInfoItemExtractor as text, sent via CommentsInfoItem#getCommentText to NewPipe, where timestamps are converted to hyperlinks using Linkify: https://github.com/TeamNewPipe/NewPipe/pull/2168 On the other hand, video descriptions are handled in NewPipeExtractor by scraping the watch-page HTML. There, timestamp links were previously mangled (and now properly parsed), before being sent as HTML via YoutubeStreamExtractor#getDescription to NewPipe (where HTML gets converted to Spanned). The logic introduced in this commit is different from the above PR, since it operates in the extractor, and mutates the HTML DOM rather than identifying via regex.	2019-08-18 01:05:41 -07:00
Christian Schabesberger	58e3996edc	Merge branch 'dev' into duplicate-subscription-fix	2019-08-18 00:42:24 +02:00
Christian Schabesberger	3e2df12f12	Merge branch 'dev' into recaptcha-with-url	2019-08-18 00:41:27 +02:00
Christian Schabesberger	92846076ce	Merge branch 'dev' into duplicate-subscription-fix	2019-08-18 00:41:16 +02:00
Stypox	06689a2f27	Add url to ReCaptchaException ... Sometimes YouTube introduces recaptchas only on some pages. By adding an url to the ReCaptchaException the NewPipe app is able to use that url to load the page that originally caused the problem. Also removed every instance of exception caught and rethrown with a different description: it makes no sense and it removes part of the useful stacktrace.	2019-08-17 09:09:07 +02:00
Stypox	d4e975e4fa	Fix search error with some playlists ... Somtimes there were two divs with class "yt-lockup-meta", so the extractor couldn't get the correct one.	2019-08-16 22:47:02 +02:00
Stypox	216a4eb1f5	Complete fix inconsistency in youtube channel urls ... It is not always possible to get the url in the form "https://www.youtube.com/channel/...", so a not has been added whenever that happens to be the case (i.e. only in InfoStreamItems).	2019-08-16 21:17:03 +02:00
Stypox	315c5c262f	Typo	2019-08-16 21:14:52 +02:00
Stypox	d14c45c948	Fix SoundCloud tests	2019-08-12 17:15:21 +02:00
Stypox	b09e402d4f	Fix wrong regex when channel id is at the end of the url ... It had no "&" at the end.	2019-08-12 16:55:39 +02:00
Stypox	31e74253f8	Fix tests	2019-08-12 16:38:56 +02:00
Stypox	09c6822b1d	Change youtube channel url test	2019-08-12 13:13:41 +02:00
Stypox	b8bc57c53f	Add tests for youtube channel urls ... They have to be in the form "https://www.youtube.com/channel/ID"	2019-08-12 11:58:50 +02:00
Stypox	6aa69a2df8	Fix inconsistency in youtube channel urls ... Urls from the youtube search extractor were "https://www.youtube.com/user/NAME" instead of "https://www.youtube.com/channel/ID". This fixes TeamNewPipe/NewPipe#2167	2019-08-12 11:57:29 +02:00
Andrew	7fb17684f5	Fixed missing colon causing builds to fail	2019-08-08 00:25:42 +00:00
Andrew	5a2dcdce16	Add Invidious instances ... Added all publicly listed Invidious instances from omarroth/invidious wiki page to the link handler factory for YouTube.	2019-08-08 00:19:02 +00:00
Christian Schabesberger	5798c8fdf5	fix duration can not be paresd ... update gradle to version 5.1 fix sts issue for agegated videos GOD DAMN FUCKING BULLSHIT add duratin for controversal/age gated videos bring back sts remove ignores fix ogg test	2019-07-31 16:11:42 +02:00
Christian Schabesberger	4488c21765	Merge pull request #159 from ritiek/better-soundcloud-thumbnail ... Improve thumbnail quality for Soundcloud service	2019-06-27 14:27:23 +02:00
TobiGr	0d09a9fd61	Fix SoundCloud playlists parsing exception ... Closes TeamNewPipe/NewPipe#2344	2019-06-26 00:56:03 +02:00
Tobias Groza	c64c90a567	Merge pull request #168 from masozzi/dev ... soundcloud parsing helper: fixed id parser regex	2019-06-02 21:06:57 +02:00
Tobias Groza	796c1b7bc0	Merge pull request #164 from TeamNewPipe/fix/test_comments ... Fix failing YouTube comments tests	2019-06-02 11:36:16 +02:00
Matteo Sozzi	93d4299f07	soundcloud parsing helper: fixed id parser regex	2019-05-31 20:15:36 +02:00
Tobias Groza	2ac713e70f	Merge pull request #160 from Stypox/invalid-youtube-subscription-fix ... Fixed youtube subscription import: ignore ones with invalid url and keep ones with empty title.	2019-05-14 22:26:25 +02:00
Tobias Groza	867ca1cabf	Fix failing YouTube comments tests ... The comment function has been disabled for the video on which we ran the test. We are testing the comments of a different video now.	2019-05-14 22:11:40 +02:00
Stypox	c70d28597b	Add fallback for urls not conaining the "sp" tag ... If ever YouTube changes thing again (or uses old urls for some unknown reason), this prevents the extractor from crashing. As suggested here: 133cc032d9 (r283529811)	2019-05-14 13:57:45 +02:00
Stypox	133cc032d9	Fix invalid yt url: signature tag name is not always "signature" ... Thanks to @omarroth for the suggestion: see TeamNewPipe/NewPipeExtractor#155	2019-05-13 21:25:35 +02:00
Stypox	0eaca52c15	Add test for subscription with invalid url. ... Also modified the test for empty title, since now subscriptions with empty title are not ignored anymore.	2019-04-28 14:19:33 +02:00
Stypox	171f2c49fe	Ignore subscriptions with invalid url and keep ones with empty title. ... if a channel if deleted (thus it has an empty title), it is imported in NewPipe anyway, so that if it becomes undeleted in the future, it will be shown in the app.	2019-04-28 14:17:52 +02:00
Stypox	d5043cdf49	Add test for subscriptions with empty title. ... (youtube subscription extractor)	2019-04-26 19:59:23 +02:00
Stypox	03893abd91	Fixed TeamNewPipe/NewPipe#2226. ... (in the youtube subscription extractor) Ignore subscriptions that have an empty title instead of throwing an error: the youtube subscription_manager XML file can sometimes contain those (i.e. deleted channels).	2019-04-26 18:54:30 +02:00
Ritiek Malhotra	c7974b2aed	Fetch better quality thumbnails ... and fallback to avatar thumbnail if track thumbnail isn't found	2019-04-26 02:59:15 +05:30
yausername	f60c973928	more javadoc	2019-03-23 19:32:06 +05:30
yausername	e4e6d44770	reordered services	2019-03-23 19:12:26 +05:30
yausername	aabc65b57d	added java doc for stream	2019-03-23 19:11:51 +05:30
yausername	07a8129a73	fixed peertube search test	2019-03-23 19:11:19 +05:30
yausername	bd22b55885	fixed youtube channel name test	2019-03-23 19:10:34 +05:30
yausername	2193119fab	youtube's comment censorship breaks test	2019-03-23 19:09:40 +05:30
Christian Schabesberger	d22786b817	Merge branch 'master' into dev	2019-03-23 10:07:28 +01:00
yausername	4effd0b36d	fix empty author name	2019-03-23 00:13:18 +05:30
Christian Schabesberger	560c648e92	fix decrypt regex for akamai 2 times in file	2019-03-14 16:49:30 +01:00
Connectety	ed78f7dadc	Merge branch 'master' into invidious-support	2019-03-14 16:07:04 +01:00
Christian Schabesberger	dd61d66cf5	speed up finding decrypt function	2019-03-14 09:07:19 +01:00
Ritvik Saraf	0a7d42f58d	set soundcloud default kiosk	2019-03-14 08:49:37 +01:00
Ritvik Saraf	53058802e2	fix comment url	2019-03-14 08:49:37 +01:00
Christian Schabesberger	e072bf6461	fix dercrypt error due to wrong dollar sign detection	2019-03-14 08:49:11 +01:00
Ritvik Saraf	c220700c94	fixed tests	2019-03-10 00:37:01 +05:30
Ritvik Saraf	36139558c6	handle stream 404 error, fixed tests	2019-03-09 23:33:51 +05:30
Ritvik Saraf	e66d188381	throw content not available	2019-03-08 04:54:39 +05:30
Ritvik Saraf	22dac63698	merged upstream/dev	2019-03-08 03:09:05 +05:30
Connectety	c255fdcdf7	Merge branch 'master' into invidious-support	2019-03-02 13:03:31 +01:00
Ritvik Saraf	a2735c4f97	fix comment url	2019-03-02 02:48:05 +05:30
Christian Schabesberger	16d693ea7a	Merge branch 'master' into serviceByUrlNPEfix	2019-03-01 09:54:41 +01:00
Ritvik Saraf	72262707bf	fixed youtube comment utf8 bom	2019-03-01 04:21:45 +05:30
Ritvik Saraf	9eff18252b	fix npe in fetching service by url	2019-02-28 22:55:18 +05:30
Christian Schabesberger	cffbd468cc	Merge branch 'master' into invidious-support	2019-02-24 21:58:59 +01:00
Ritvik Saraf	948a7826ab	fetch channel id for channel url	2019-02-23 19:03:52 +05:30
Connectety	28c5b86f6d	Merge branch 'master' into invidious-support	2019-02-20 17:58:21 +01:00
Ritvik Saraf	3dadf63028	refactored comments capability	2019-02-16 00:57:00 +05:30
Ritvik Saraf	a97b6dfa7a	mediaccc merge	2019-02-16 00:41:23 +05:30
Ritvik Saraf	f8fb7b6500	Merge remote-tracking branch 'upstream/master'	2019-02-16 00:18:39 +05:30
Connectety	5079d5efe1	Merge branch 'master' into invidious-support	2019-02-07 23:06:19 +01:00
Ritvik Saraf	f97d5ab4cd	Merge remote-tracking branch 'upstream/master'	2019-01-29 22:10:07 +05:30
Christian Schabesberger	79b0a19d1a	make search filter empty be equal to all	2019-01-29 16:49:37 +01:00
Christian Schabesberger	d0efe8bd47	fix ogg	2019-01-29 16:04:19 +01:00
Christian Schabesberger	644da4fc3c	add ogg as audioformat	2019-01-28 15:43:21 +01:00
Christian Schabesberger	14e1ccdb86	add conferences search	2019-01-28 15:30:17 +01:00
Christian Schabesberger	1503459292	add kiosk for conferences	2019-01-28 12:18:16 +01:00
Connectety-W	6390eb268b	fixed YoutubePlaylistLinkHandlerFactory accepting invalid links	2019-01-27 12:05:36 +01:00
Connectety-W	1ab7a1f930	added tests for YoutubePlaylistLinkHandlerFactory	2019-01-27 12:00:23 +01:00
Connectety-L	ec4aa9e0cd	added Invidio subdomain test and fixed error in test caused by Invidio playlist support	2019-01-27 02:12:12 +01:00
Connectety-L	10939efcce	added support playlists on Invidio	2019-01-27 01:44:46 +01:00
Connectety-L	cce5e4ad33	added support and tests for Invidio Trending-URLs	2019-01-27 01:29:23 +01:00
Connectety-L	7493ed903b	split isYoutubeALikeURL into multiple methods	2019-01-27 01:28:51 +01:00
Christian Schabesberger	cb51254aa3	return one null less	2019-01-26 22:55:34 +01:00
Christian Schabesberger	73232a7bad	stream names may not contain dots	2019-01-26 17:47:58 +01:00
Christian Schabesberger	50a17afc05	fix issue with originalUrl	2019-01-26 17:47:58 +01:00
Christian Schabesberger	cf3ea22753	make stream size have a p in the end	2019-01-26 17:47:58 +01:00
Christian Schabesberger	7fcb3f5790	fix crash when return null as a related streams collector	2019-01-26 17:47:58 +01:00
Christian Schabesberger	2148edc7d7	add channel and strem extractor for mediaccc	2019-01-26 17:47:58 +01:00
Christian Schabesberger	ef576341c8	implement searchextractor for mediaccc	2019-01-26 15:22:16 +01:00
Connectety-L	2ede47d36c	added hooktube and invidio http test	2019-01-24 14:19:44 +01:00
Connectety-L	2ae23a6f79	added support for videos on invidio.us	2019-01-24 11:13:01 +01:00
Connectety-L	399b4f2eef	added support for "vnd.youtube.launch" URI-scheme	2019-01-24 10:53:03 +01:00
Connectety-L	ae23059d66	added support for channels on invidio.us	2019-01-24 10:48:29 +01:00
Connectety-L	79ba6aba95	added tests from https://github.com/TeamNewPipe/NewPipeExtractor/pull/128	2019-01-24 10:27:01 +01:00
Connectety-W	19288c1456	added forgotten break statements	2019-01-20 14:39:06 +01:00
Christian Schabesberger	76a3742084	Merge branch 'master' into master	2019-01-20 14:34:16 +01:00
Connectety-W	a6c972eff8	fixed tests by prepending HTTP to URLs without protocol and adding a check for null.	2019-01-20 01:31:30 +01:00
Ritvik Saraf	c60d6ec0ab	removed unused import	2019-01-19 18:20:02 +05:30
Ritvik Saraf	50c4783f71	fixed extracting hls url	2019-01-19 18:07:35 +05:30
Ritvik Saraf	c4e502b9d2	Merge branch 'master' into peertube	2019-01-19 14:33:01 +05:30
Ritvik Saraf	25ed9deaf3	Merge remote-tracking branch 'upstream/master'	2019-01-19 14:28:12 +05:30
Christian Schabesberger	97d72590fc	Merge branch 'master' into master	2019-01-18 22:31:37 +01:00
Christian Schabesberger	99915e4527	fix failing tests	2019-01-18 12:44:34 +01:00
Christian Schabesberger	6776abdd55	Merge https://github.com/The-Twisted-Samurai/NewPipeExtractor	2019-01-18 12:25:20 +01:00
Christian Schabesberger	09bafe0660	fix failing viewcount test	2019-01-18 12:24:30 +01:00
Kunal Sareen	b6790bbe6b	Updating regex	2019-01-18 21:47:34 +11:00
Connectety	43ffeac023	Merge branch 'master' into master	2019-01-13 13:38:35 +01:00
Connectety-W	98f49852d7	refactored YouTube-linkHandler to use less regex and more URL-methods	2019-01-13 12:52:07 +01:00
Ritvik Saraf	fade7bd749	getter for torrent url	2018-12-30 15:23:24 +05:30
Ritvik Saraf	ef0ffb2229	added torrent url in streams	2018-12-30 15:00:57 +05:30
Ritvik Saraf	b1a77fa484	update peertube instance	2018-12-29 22:23:35 +05:30
Ritvik Saraf	a83342de0f	update peertube instance	2018-12-29 21:58:43 +05:30
Ritvik Saraf	b05fa45080	resolved review comments	2018-12-28 13:02:00 +05:30
Ritvik Saraf	b2c6928459	added logic for fetching related streams	2018-12-26 14:29:23 +05:30
Ritvik Saraf	bc82a53f2c	replace base url	2018-12-26 13:07:06 +05:30
Ritvik Saraf	203c884d51	strip base url	2018-12-26 13:02:04 +05:30
Ritvik Saraf	14cd1dbcbb	fixed kiosk by url	2018-12-26 12:50:43 +05:30
Ritvik Saraf	8755c25349	format date of comment published. changed default instance	2018-12-26 11:08:39 +05:30
Ritvik Saraf	df0db8468d	merged master	2018-12-25 19:12:22 +05:30
Ritvik Saraf	c77050dc70	handle empty comments	2018-12-23 08:24:36 +05:30
Ritvik Saraf	9ad102df3f	fixed fetching youtube client name	2018-12-23 08:24:36 +05:30
Ritvik Saraf	4c49a347f6	merged upstream/master	2018-12-04 21:20:26 +05:30
Christian Schabesberger	91b1efc97e	add documentation of StreamingService	2018-11-10 10:50:13 +01:00
Christian Schabesberger	a78ad16235	rebase correctly	2018-11-09 19:55:40 +01:00
kapodamy	b40a1f3657	Delete Subtitles.java ... change class name	2018-11-08 17:06:41 -03:00
kapodamy	388f4fd38b	Delete SubtitlesFormat.java ... merge into MediaFormat	2018-11-08 16:29:06 -03:00
kapodamy	e4afb21862	make Subtitle object Stream compliant ... * merge SubtitlesFormat into MediaFormat * implement Stream interface on Subtitle class * misc fixes: dont show a snackbar error on age-restricted videos, lint fix.	2018-11-08 16:29:05 -03:00
Christian Schabesberger	7129d6db55	add inline documentation for StreamExtractor	2018-11-07 18:28:44 +01:00
Christian Schabesberger	4de99ae28f	add support for segmented streams	2018-11-06 14:24:47 +01:00
Christian Schabesberger	32d316330c	fix broken search results	2018-10-25 15:46:47 +02:00
Ritvik Saraf	f58c914e73	merge fix	2018-10-19 20:17:26 +05:30
Ritvik Saraf	05ef80c2eb	Merge remote-tracking branch 'upstream/master'	2018-10-19 20:09:51 +05:30
Ritvik Saraf	99a0134b1c	removed unchecked cast	2018-10-19 19:33:36 +05:30
Ritvik Saraf	4883b6fb48	return suggestion extractor	2018-10-12 13:04:51 +05:30
Ritvik Saraf	706d4271a6	empty suggestions for search	2018-10-12 12:45:09 +05:30
Ritvik Saraf	c9fba9cb1e	fallback avatar for channel	2018-10-12 02:27:32 +05:30
Ritvik Saraf	26da3088ba	fallback avatar and description	2018-10-12 01:59:13 +05:30
Ritvik Saraf	9dee8d5fcd	updated kiosk accept link	2018-10-12 01:37:47 +05:30
Ritvik Saraf	20f280cb57	added peertube extractor	2018-10-12 00:40:22 +05:30
Christian Schabesberger	24cb684e23	fix failing test	2018-10-06 17:11:12 +02:00
Christian Schabesberger	0920680708	fix search country for next page	2018-10-06 17:03:55 +02:00
Christian Schabesberger	0c3dc86b07	add support for yt content country	2018-10-06 12:22:37 +02:00
Christian Schabesberger	3a865749e8	fix issues Kiosk issue about localization, nad rename to preferred localization	2018-10-05 16:01:10 +02:00
Ritvik Saraf	e85958b180	merged upstream/master	2018-09-29 13:19:00 +05:30
Ritvik Saraf	d1ff1c7589	using mobile website since it is faster	2018-09-28 04:54:57 +05:30
Ritvik Saraf	c2ed99b1b7	no comments	2018-09-27 23:01:27 +05:30
Ritvik Saraf	ad8066830d	getting client version and name from initial page	2018-09-27 22:32:13 +05:30
Ritvik Saraf	6b620914b6	moved cookie logic outside	2018-09-27 02:04:12 +05:30
Ritvik Saraf	fb1419608a	using getDataString	2018-09-27 00:44:55 +05:30
Ritvik Saraf	ce76885553	removed generics	2018-09-26 04:21:58 +05:30
Ritvik Saraf	8e27801183	removed jackson and java 8	2018-09-26 03:20:29 +05:30
Christian Schabesberger	5223aece7b	fix failing unit test	2018-09-24 15:17:57 +02:00
Christian Schabesberger	f334dd07de	fix youtub.be links in description	2018-09-24 15:06:00 +02:00
Christian Schabesberger	ad4b15ac66	Merge pull request #114 from TeamNewPipe/localization ... Localization	2018-09-24 14:00:20 +02:00
Ritvik Saraf	c1199c8fcf	added isCommentsSupported method	2018-09-23 01:12:11 +05:30
Ritvik Saraf	0e86475891	removed commentsInfo from streamInfo	2018-09-22 23:36:41 +05:30
Ritvik Saraf	7ed0da0493	more testing	2018-09-22 19:09:31 +05:30
Ritvik Saraf	6a0341d59c	testing	2018-09-22 14:55:59 +05:30
Christian Schabesberger	49c2eb5185	fix failing watch links	2018-09-20 13:51:06 +02:00
Ritvik Saraf	e04787f340	fixed NPE for services where comments is not available	2018-09-19 05:32:14 +05:30
Ritvik Saraf	4794e16dcb	removed comment details form streamInfo. added commentsInfo instead	2018-09-19 04:58:40 +05:30
Ritvik Saraf	ee239985ae	added CommentsInfo	2018-09-19 04:58:40 +05:30
Ritvik Saraf	4ca23ab5c3	revering serialzable change	2018-09-19 04:58:40 +05:30
Ritvik Saraf	bf2d3deb03	make extractor serializable	2018-09-19 04:58:40 +05:30
Ritvik Saraf	823551170d	added loadable comments in stream info	2018-09-19 04:58:40 +05:30
Ritvik Saraf	9fb0622a24	better quality thumbnails	2018-09-19 04:58:40 +05:30
Ritvik Saraf	f62f147ea0	added comments to stream info	2018-09-19 04:58:40 +05:30
Ritvik Saraf	06898f47b2	close resource	2018-09-19 04:58:40 +05:30
Ritvik Saraf	95575756ee	added http post method in downloader, formatting	2018-09-19 04:58:40 +05:30
Ritvik Saraf	8b8779b176	removing catch exception	2018-09-19 04:58:40 +05:30
Ritvik Saraf	53d3997904	added comments extractor	2018-09-19 04:58:40 +05:30
Christian Schabesberger	ce2bbee1e9	add propper localization	2018-09-15 22:29:28 +02:00
Christian Schabesberger	dc0d0bda24	replace uiHandler name with linkhandler	2018-09-15 22:29:28 +02:00
Christian Schabesberger	ae8107b182	Merge branch 'master' into master	2018-09-15 22:18:54 +02:00
Christian Schabesberger	96b4c97cee	Merge pull request #109 from karyogamy/sig-fix-update ... Decryption Signature Regex Update	2018-09-15 22:10:31 +02:00
Christian Schabesberger	217d13b102	fix wrong subscription count	2018-09-11 15:14:22 +02:00
Christian Schabesberger	8a4afe2548	refactor split time parsing	2018-09-09 14:01:39 +02:00
skil3z	a83d020944	Accommodate time formatting for different countries ... If there's a . in the time format, this detects it and uses is instead of : This removes errors and lag related to "Could not get duration" while using NewPipe in countries with official time formatting with . (dot) instead of : (punctuation colon) Tested to compile and work on real device	2018-09-09 12:53:10 +03:00
John Zhen Mo	ed73ae55f1	-Added more decrypt function name matching regex. ... -Cleaned up decryption code generation method.	2018-09-07 22:25:07 -07:00
Christian Schabesberger	66c3c3f452	fix channel links in description part 2	2018-09-07 22:18:22 +02:00
Christian Schabesberger	4469d11307	fix channel links in description	2018-09-07 21:40:36 +02:00
John Zhen Mo	119843bfac	-Fix signature extraction parse exception.	2018-09-07 11:34:14 -07:00
Mauricio Colli	850670917f	Quick fix for the kiosks in SoundCloud	2018-09-05 07:25:24 -03:00
Mauricio Colli	834382111b	Fix NPE when playlist is empty	2018-09-03 22:37:31 -03:00
Mauricio Colli	0400ae026f	Fix channels with subscription count disabled ... Related: TeamNewPipe/NewPipe#1649	2018-09-03 22:37:31 -03:00
Mauricio Colli	f6be85e2f5	Merge branch 'dev' into 'master'	2018-09-03 22:37:31 -03:00
Christian Schabesberger	f498dd7875	fix failing unit tests ... fix yt share url error	2018-08-28 17:19:22 +02:00
Christian Schabesberger	fef71aeccc	roleback using href for description links	2018-08-28 11:55:12 +02:00
Christian Schabesberger	3aa7ff6d0e	make ytdescription alter href instead of the text of links	2018-08-27 20:45:43 +02:00
Christian Schabesberger	e662c97433	make dash parser ignore segmented streams	2018-08-21 17:23:56 +02:00
Christian Schabesberger	c4e16c7337	fix hashtag parsing	2018-08-17 16:22:50 +02:00
Christian Schabesberger	981cb333b5	fix link parsing for yt internal links ... blub	2018-08-16 17:44:09 +02:00
Christian Schabesberger	389a87fc89	add link parsing for youtube description	2018-08-16 17:11:18 +02:00
Christian Schabesberger	aeb813840d	fix search querry tests	2018-08-05 14:14:36 +02:00
Christian Schabesberger	701666f498	block yt premium videos ... fix logig error for block yt premium videos	2018-08-05 13:04:49 +02:00
Christian Schabesberger	af1dddb79e	Merge pull request #96 from Bleuzen/enable_opus ... Enable opus format 251	2018-08-01 18:21:50 +02:00
oscar	a077cb9777	Small YoutubeStreamLinkHandlerFactory refactoring	2018-07-25 17:21:42 +02:00
oscar	a9ce0b29d0	Fixed improper handling of playlist deep links	2018-07-25 17:15:56 +02:00
Bleuzen	9af07a2562	re-enable opus	2018-07-24 17:25:42 +02:00
Christian Schabesberger	1eff8c5708	rename filter playlist to playlists	2018-07-19 16:16:37 +02:00
Christian Schabesberger	558a973e43	rename search filters	2018-07-19 16:06:44 +02:00
Christian Schabesberger	8ee068fd98	fix names in kiosklist ... blub	2018-07-13 21:50:49 +02:00
Christian Schabesberger	28788a05db	rename uih and remove afiliate link foo	2018-07-13 18:02:40 +02:00
Christian Schabesberger	a1aaca1bea	get info from initial page	2018-07-08 20:49:13 +02:00
Christian Schabesberger	53f0bc9d8d	add getInfo without need for search extractor to searchinfo	2018-07-08 20:15:14 +02:00
Christian Schabesberger	35b46900c1	add outcomming items of searchextractor to searchinfo	2018-07-08 19:53:25 +02:00
Christian Schabesberger	4746a1c48a	upgrade kisok uriIdhandler to ListUIHandler	2018-07-08 15:27:35 +02:00
Christian Schabesberger	31b0480e22	fix failing tests	2018-07-08 14:43:49 +02:00
Christian Schabesberger	2f351be772	add getMoreInfo to SearchInfo	2018-07-08 14:32:31 +02:00
Christian Schabesberger	812a785811	remove searchengine	2018-07-02 13:47:39 +02:00
Christian Schabesberger	291de18418	getUIHandler() to getUIHFactory() ... handler to handlerFactory in kiosk	2018-07-01 19:01:39 +02:00
Christian Schabesberger	bd5423fe2a	make less tests fail	2018-07-01 16:55:48 +02:00
Christian Schabesberger	17f46b8b12	rename UrlIdHandler to UIHFactory	2018-07-01 16:55:48 +02:00
Christian Schabesberger	9bda761103	add test for soundcloud search extractor	2018-07-01 16:55:48 +02:00
Christian Schabesberger	ef2ce6854c	add soundcloud SearchExtractor	2018-07-01 16:55:48 +02:00
Christian Schabesberger	5718d5b8b4	add tests for searchextractor	2018-07-01 16:55:48 +02:00
Christian Schabesberger	06c67763d2	remove soundcloud and make first search test work	2018-07-01 16:55:48 +02:00
Christian Schabesberger	b4544a67e8	add SearchExtractor	2018-07-01 16:55:48 +02:00
Christian Schabesberger	0501a2f543	fix donation link parsing	2018-05-08 21:58:35 +02:00
Christian Schabesberger	94d1eb6f32	restructure youtube service	2018-05-08 21:19:03 +02:00
Christian Schabesberger	08f0247d73	make UrlIdHandler actual wrapper for the url/id ... fix tests fix tests	2018-05-06 19:51:24 +02:00
Christian Schabesberger	b7c1f251d8	add filter to stream lists	2018-05-05 20:07:47 +02:00
Christian Schabesberger	bf1c771662	fix could not parese metadata despide available error	2018-05-04 16:11:25 +02:00
Christian Schabesberger	bad67f0bc3	Merge branch 'dev' of github.com:TeamNewPipe/NewPipeExtractor into dev	2018-04-29 21:31:45 +02:00
Christian Schabesberger	466865385e	add support for affiliate	2018-04-29 21:31:24 +02:00
Christian Schabesberger	016c2fc549	add channel donations for youtube	2018-04-08 15:58:42 +02:00
Mauricio Colli	1c8dafe4c6	Lightweight method to get the client id on SoundCloud ... - Instead of downloading the whole ~1MB file, download just the first 16KB. With fallback to the old way in case of fail - I've come across some technical difficulties as to how to limit the download (current implementation is too basic/simple for that), but in the end, a simple http header (Range) was enough	2018-04-07 22:12:27 -03:00
Christian Schabesberger	17e7e5a359	enable donations for streams	2018-04-07 21:36:20 +02:00
Christian Schabesberger	1d94e7d477	add ability to get donation links from channel	2018-04-07 16:45:07 +02:00
Mauricio Colli	77a74b8d20	Add "originalUrl" field to Info's object	2018-04-06 03:06:46 -03:00
Mauricio Colli	3fe9922d49	Fix failing test due to an invalid path	2018-04-06 03:06:33 -03:00
Christian Schabesberger	a6b6235644	return propper name for soundcloud kisok extractor	2018-04-01 20:27:44 +02:00
Christian Schabesberger	22c59a4895	changed implement me to SoundCloud Charts	2018-03-31 18:38:22 +02:00
Christian Schabesberger	9664658914	Merge branch 'master' of github.com:TeamNewPipe/NewPipeExtractor	2018-03-25 16:08:35 +02:00
Christian Schabesberger	f2067338db	move on to version 0.13.0, and made ListCollector only accept InfoItemExtracto	2018-03-25 16:08:14 +02:00
Mauricio Colli	fa3974bf3a	Fix javadoc generation and some errors ... - Generate javadoc containing all the classes from all submodules	2018-03-18 16:18:11 -03:00
Mauricio Colli	f787b375e5	Created gradle module and moved existing code to new one	2018-03-14 00:44:02 -03:00