495 Commits

Author	SHA1	Message	Date
wb9688	612ec06839	Actually fix thumbnail URLs starting with //	2020-02-28 09:36:33 +01:00
wb9688	f946310af5	Fix search queries with a promotedSparklesTextSearchRenderer returning 0 results	2020-02-28 08:57:44 +01:00
wb9688	94a2d5be46	Fix thumbnail URLs starting with //	2020-02-27 19:08:46 +01:00
wb9688	838d834ce2	Get Uploads view of Videos tab	2020-02-27 18:54:27 +01:00
wb9688	365b0329f3	Implement getTextFromObject() function	2020-02-27 17:39:23 +01:00
wb9688	0798bdd5cd	Fix getSubscriberCount() for 0 subscribers	2020-02-27 16:26:22 +01:00
wb9688	8ebd971648	Fix channel descriptions consisting of multiple parts	2020-02-27 10:06:35 +01:00
wb9688	880b951088	Fix getUploaderAvatarUrl() in YoutubeStreamExtractor	2020-02-27 09:53:59 +01:00
wb9688	8aa560bef4	Fix video titles consisting of multiple parts due to @	2020-02-27 09:42:22 +01:00
wb9688	951ed9f0d8	Don't call getUploaderInfo() in onFetchPage() for playlists ... This way YouTube Music playlists will keep working in NewPipe	2020-02-27 09:27:56 +01:00
wb9688	2399d46ab0	Fix YoutubeChannelExtractor for channels without videos	2020-02-27 09:21:25 +01:00
wb9688	cdbc751b87	Fix getUploaderUrl() in YoutubeStreamInfoItemExtractor	2020-02-27 09:05:41 +01:00
wb9688	db305408e9	Get all expandedShelfContentsRenderers in YoutubeTrendingExtractor	2020-02-26 20:37:20 +01:00
wb9688	a2d8489e16	Parse timestamps in description	2020-02-26 20:27:30 +01:00
wb9688	8d503407ef	Parse browseEndpoint and watchEndpoint in descriptions	2020-02-26 19:37:58 +01:00
wb9688	8dc39d517a	Fix tests ... Except testGetFullLinksInDescription() in DescriptionTestUnboxing, since that requires other changes first.	2020-02-26 17:31:01 +01:00
wb9688	88282761f4	Fix YoutubeStreamExtractor not being able to getAgeLimit() in onFetchPage()	2020-02-26 16:19:42 +01:00
wb9688	bb3a3d70bf	Use pbj in YoutubeTrendingExtractor	2020-02-26 16:10:24 +01:00
wb9688	1c3a4e710b	Check if there are no related streams in getAgeLimit()	2020-02-26 16:03:06 +01:00
wb9688	985c3ec877	Improve getClientVersion()	2020-02-26 15:27:50 +01:00
wb9688	15afbea3e1	Use pbj in YoutubePlaylistExtractor	2020-02-26 15:27:50 +01:00
wb9688	89a41a7f69	Use pbj in YoutubeChannelExtractor	2020-02-26 15:27:50 +01:00
wb9688	0973263aab	Use pbj in YoutubeSearchExtractor	2020-02-26 15:27:46 +01:00
TobiGr	fc465c8bf7	Fix getUploadDate() for premiered videos with a given date ... Detect publishDate and uploadDate	2020-02-25 22:54:37 +01:00
TobiGr	96285e0815	Fix getUploadDate() for premiered videos with a given date	2020-02-25 21:51:30 +01:00
wb9688	5a35300a5e	Fix parsing upload date for premiered streams	2020-02-25 21:51:30 +01:00
wb9688	729fd2eaee	Fix parsing description for navigationEndpoint without urlEndpoint	2020-02-25 21:51:30 +01:00
wb9688	26fb44595f	Fix parsing description	2020-02-25 21:51:30 +01:00
TobiGr	0fff03038e	Get description with correct links	2020-02-25 21:51:30 +01:00
wb9688	5d08c34322	Fix parsing upload date in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	bbe1a3cd62	Use getVideo(Primary|Secondary)InfoRenderer()	2020-02-25 21:51:30 +01:00
wb9688	8e6be880d7	Simplify getId() in YoutubeChannelExtractor	2020-02-25 21:51:30 +01:00
TobiGr	ecfc27a92c	Implement fallback methods for getDescription() and getTextualUploadDate() in YouTubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	eed29ea734	Return null for related streams at age restricted videos	2020-02-25 21:51:30 +01:00
TobiGr	9efcc61ca6	Adapt some tests to match the new URLs	2020-02-25 21:51:30 +01:00
TobiGr	f39603f6ef	Implement getUploadDate() in YouTubeStreamInfoItemExtractor	2020-02-25 21:51:30 +01:00
wb9688	26ea3dceb6	Fix getViewCount() in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	76d54abdbf	Reimplement more methods in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	f13c0288cc	Reimplement some methods in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	02b59903fa	Remove useless code	2020-02-25 21:51:30 +01:00
TobiGr	dd4dd849dc	Get client version dynamically in YouTubeSearchExtractor	2020-02-25 21:51:30 +01:00
TobiGr	583e9c1571	Fix getPage() ... Someone should check if there are unstaged changes before committing...	2020-02-25 21:51:30 +01:00
TobiGr	5842b9ad37	Add getClientVersion() and HARDCODED_CLIENT_VERSION to YouTubeParsingHelper ... Prefer hardcoded client version above the current one when making requests to retrieve the same JSON structure for each request.	2020-02-25 21:51:30 +01:00
wb9688	5d883d100c	Implement pagination in YoutubeSearchExtractor	2020-02-25 21:51:30 +01:00
wb9688	c0a8e01889	Implement pagination in YoutubePlaylistExtractor	2020-02-25 21:51:30 +01:00
wb9688	4039409820	Fix getLikeCount() for certain streams	2020-02-25 21:51:30 +01:00
wb9688	627ab2459f	Uncomment fetchPage()	2020-02-25 21:51:30 +01:00
wb9688	2dfa2187ff	Implement pagination in YoutubeChannelExtractor	2020-02-25 21:51:30 +01:00
wb9688	a38ab9b791	Return null if channel has no banner	2020-02-25 21:51:30 +01:00
wb9688	1eca63089b	Count private and deleted videos as ad	2020-02-25 21:51:30 +01:00
wb9688	c7360e4a46	Fix getThumbnailUrl() in YoutubeChannelInfoItemExtractor	2020-02-25 21:51:30 +01:00
wb9688	51fb26625a	Implement getSubscriberCount() in YoutubeChannelInfoItemExtractor	2020-02-25 21:51:30 +01:00
TobiGr	6d20b2b1d0	Fix NPE on collecting page items	2020-02-25 21:51:30 +01:00
wb9688	4462cbe3f1	Reimplement YoutubePlaylistInfoItemExtractor	2020-02-25 21:51:30 +01:00
wb9688	8aea4d445b	Reimplement YoutubeChannelInfoItemExtractor	2020-02-25 21:51:30 +01:00
wb9688	3187116a63	Handle premium videos	2020-02-25 21:51:30 +01:00
wb9688	7442f91aa6	Don't assume which channel tab is videos	2020-02-25 21:51:30 +01:00
wb9688	316fe0109d	Fix first playlist page	2020-02-25 21:51:30 +01:00
wb9688	4e57e589ce	Fix first channel page	2020-02-25 21:51:30 +01:00
TobiGr	5816202cc7	Move getInitialData() method to YouTubeParsingHelper ... Rename ytInitialData to initialData	2020-02-25 21:51:30 +01:00
wb9688	38aabc6aca	Use plain YoutubeStreamInfoItemExtractor in YoutubeTrendingExtractor	2020-02-25 21:51:30 +01:00
wb9688	957db062ef	Fix getting uploader for videoRenderer	2020-02-25 21:51:30 +01:00
wb9688	b88188d419	Move stuff from extractVideoPreviewInfo() into YoutubeStreamInfoItemExtractor and partially fix search	2020-02-25 21:51:30 +01:00
wb9688	af49b3c487	Fix live streams in extractVideoPreviewInfo()	2020-02-25 21:51:30 +01:00
TobiGr	f33f9466ce	Fix testDescription() in ChannelExtractor	2020-02-25 21:51:30 +01:00
TobiGr	10e9c16d8c	Fix LiveStream view count	2020-02-25 21:51:30 +01:00
wb9688	127c4d5893	Fix getNextStream() in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
wb9688	7bfc0e62c6	Fix getRelatedStreams() in YoutubeStreamExtractor	2020-02-25 21:51:30 +01:00
TobiGr	12166ca60c	[StreamExtractor] Add fallback method for uploader avatar url	2020-02-25 21:51:30 +01:00
wb9688	3ec422a542	Fix like/dislike parsing	2020-02-25 21:51:30 +01:00
TobiGr	a34e5c18e1	Trending StreamInfoItemCollecetor	2020-02-25 21:51:30 +01:00
TobiGr	b705515da0	Adapt most playlist fields	2020-02-25 21:51:30 +01:00
TobiGr	21253abd9b	Use Firefox ESR User-Agent: 68	2020-02-25 21:51:30 +01:00
TobiGr	655c999795	Detect disabled subriber count correctly ... Fix parsing of kiosk name	2020-02-25 21:51:30 +01:00
TobiGr	7dcc9f159b	Stream: fix uploader avatar url	2020-02-25 21:51:30 +01:00
TobiGr	be3e20e263	Adapt most channel changes	2020-02-25 21:51:30 +01:00
TobiGr	39bf1ff1eb	Add ytInitialData regex	2020-02-25 21:51:30 +01:00
Tobias Groza	a129c65c63	more improvements of comments ... Co-Authored-By: Stypox <stypox@pm.me>	2020-02-16 23:59:31 +01:00
TobiGr	0a4115286b	Apply one suggestion	2020-02-15 13:36:54 +01:00
Tobias Groza	6822574588	Fix typos ... Co-Authored-By: B0pol <bopol@e.email>	2020-02-15 13:36:54 +01:00
TobiGr	030465b5d4	Improve code formatting and optimise imports	2020-02-15 13:36:54 +01:00
TobiGr	9112a106ea	[SoundCloud] Update client_id	2020-02-08 23:09:03 +01:00
TobiGr	008b6f505c	[PeerTube] Fix subscriber count in ChannelExtractorTest	2020-02-08 23:08:37 +01:00
TobiGr	0e33249c85	Fix SoundCloud description test	2020-02-08 22:20:20 +01:00
bopol	11bcc78d9c	Description implements Serializable. fix NotSerializableException	2020-02-07 14:10:54 +01:00
bopol	0f8a7f9df2	fix testGetUploadDate for PeerTubeStreamExtractor	2020-02-07 13:33:50 +01:00
bopol	70a40e7388	Description: rm constructor by serviceId	2020-02-07 13:28:27 +01:00
bopol	26c65b2948	Create class Description	2020-02-06 23:35:46 +01:00
bopol	5756df8dc7	Use GMT as base time (actually fix upload date)	2020-02-06 22:33:48 +01:00
B0pol	b671a4ba18	Merge branch 'dev' into peertube	2020-02-01 18:18:23 +00:00
Mauricio Colli	26234a1c0f	Introduce FeedExtractor making fetching from dedicated feeds possible ... YouTube, for example, has a dedicated feed which was built to be used like this.	2020-01-28 02:44:18 -03:00
Mauricio Colli	be81f2945c	[YouTube] Use correct upload date flag in StreamExtractor	2020-01-28 02:44:17 -03:00
Mauricio Colli	5c0c35064c	Use clean url and id when creating a channel info	2020-01-28 02:44:16 -03:00
TobiGr	033a9fb8e3	Revert change which I accidentally committed while fixing the decryption ... function in 7b72fd2a7d	2020-01-25 21:08:17 +01:00
B0pol	e392b6c68f	getLanguageInfo returns Locale instead of String ... so that java can automatically translate with Locale.getDisplayLanguage(), instead of always having English name of the language	2020-01-25 14:12:38 +01:00
B0pol	341372c0d0	reindenting (ctrl alt l) on JsonUtils and PeertubeStreamExtractor	2020-01-24 20:16:24 +01:00
B0pol	b816e48216	Merge branch 'dev' into peertube	2020-01-24 20:10:47 +01:00
TobiGr	f8d117f6cd	Merge remote-tracking branch 'origin/master' into dev	2020-01-24 19:22:40 +01:00
TobiGr	7b72fd2a7d	[YouTube] Add new decryption function	2020-01-24 02:10:56 +01:00
TobiGr	bce87f3d01	Improve getDescriptionFuncName by removing catches and adding a loop	2020-01-24 02:10:38 +01:00