kavin/NewPipeExtractor
1
0
Fork 0
mirror of https://github.com/TeamNewPipe/NewPipeExtractor.git synced 2024-12-15 23:00:33 +05:30
Code Issues Projects Releases Wiki Activity
1,973 Commits 10 Branches 75 Tags 199 MiB
67288a0191
Commit Graph

1973 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
TobiGr
030465b5d4 Improve code formatting and optimise imports 2020-02-15 13:36:54 +01:00
TobiGr
fc9f03178f Merge branch 'master' into dev 2020-02-15 00:35:45 +01:00
TobiGr
33961b2092 Version 0.18.3 2020-02-10 21:12:39 +01:00
TobiGr
aae3476ee4 [SoundCloud] Update client_id 2020-02-10 21:11:09 +01:00
TobiGr
9112a106ea [SoundCloud] Update client_id 2020-02-08 23:09:03 +01:00
TobiGr
008b6f505c [PeerTube] Fix subscriber count in ChannelExtractorTest 2020-02-08 23:08:37 +01:00
Tobias Groza
3add704f5d
Merge pull request #239 from B0pol/peertube 
[PeerTube] added metadata, fix descriptions, fix thumbnail, fix upload date, fix age limit, update tests.
 2020-02-08 22:31:02 +01:00
TobiGr
0e33249c85 Fix SoundCloud description test 2020-02-08 22:20:20 +01:00
Fynn Godau
36a316eea5
Merge branch 'dev' into dev 2020-02-08 09:43:13 +01:00
bopol
11bcc78d9c Description implements Serializable. fix NotSerializableException 2020-02-07 14:10:54 +01:00
bopol
0f8a7f9df2 fix testGetUploadDate for PeerTubeStreamExtractor 2020-02-07 13:33:50 +01:00
bopol
70a40e7388 Description: rm constructor by serviceId 2020-02-07 13:28:27 +01:00
bopol
26c65b2948 Create class Description 2020-02-06 23:35:46 +01:00
bopol
5756df8dc7 Use GMT as base time (actually fix upload date) 2020-02-06 22:33:48 +01:00
B0pol
b671a4ba18
Merge branch 'dev' into peertube 2020-02-01 18:18:23 +00:00
Tobias Groza
62b81c3607
Merge pull request #222 from mauriciocolli/feed-extractor 
Introduce FeedExtractor to fetch from dedicated feeds when available
 2020-02-01 18:41:26 +01:00
Mauricio Colli
26234a1c0f
Introduce FeedExtractor making fetching from dedicated feeds possible 
YouTube, for example, has a dedicated feed which was built to be used
like this.
 2020-01-28 02:44:18 -03:00
Mauricio Colli
be81f2945c
[YouTube] Use correct upload date flag in StreamExtractor 2020-01-28 02:44:17 -03:00
Mauricio Colli
5c0c35064c
Use clean url and id when creating a channel info 2020-01-28 02:44:16 -03:00
TobiGr
033a9fb8e3 Revert change which I accidentally committed while fixing the decryption 
function in 7b72fd2a7d
 2020-01-25 21:08:17 +01:00
B0pol
e392b6c68f getLanguageInfo returns Locale instead of String 
so that java can automatically translate with Locale.getDisplayLanguage(), instead of always having English name of the language
 2020-01-25 14:12:38 +01:00
B0pol
341372c0d0 reindenting (ctrl alt l) on JsonUtils and PeertubeStreamExtractor 2020-01-24 20:16:24 +01:00
B0pol
b816e48216
Merge branch 'dev' into peertube 2020-01-24 20:10:47 +01:00
TobiGr
f8d117f6cd Merge remote-tracking branch 'origin/master' into dev 2020-01-24 19:22:40 +01:00
Tobias Groza
ff61e28424
Merge pull request #243 from TeamNewPipe/fix/yt_decryption 
Fix/yt decryption
 2020-01-24 02:18:40 +01:00
TobiGr
7b72fd2a7d [YouTube] Add new decryption function 2020-01-24 02:10:56 +01:00
TobiGr
bce87f3d01 Improve getDescriptionFuncName by removing catches and adding a loop 2020-01-24 02:10:38 +01:00
TobiGr
9b45c61103 Typos, comments and formatting 2020-01-24 02:10:18 +01:00
TobiGr
29a4cc78bf Fix typo in decryption constant 2020-01-24 02:10:08 +01:00
B0pol
812c8e0ad2 authorName in comments now follow PeerTube website 
https://peertube.cpy.re/videos/watch/d2a5ec78-5f85-4090-8ec5-dc1102e022ea
anonyme zirbeldrüse is his displayName, what was displayed in NewPipe.
but on the website, it's shown 777@mastodon.xyz
 2020-01-24 00:22:05 +01:00
bopol
c790261eed update test 2020-01-23 19:08:41 +01:00
bopol
a691d6d0fc fix upload date: there was a one hour delay 
on peertube.co.uk: https://i.imgur.com/8Pai1rb.png
on newpipe, before this commit: https://i.imgur.com/NIRbs4Z.png
on newpipe, with this commit: https://i.ibb.co/mhKKtRD/Screenshot-20200123-185422-New-Pipe-Debug.png
 2020-01-23 19:02:40 +01:00
bopol
20da4750f8 empty support returns "", same for empty description 2020-01-23 14:37:14 +01:00
bopol
74439f692a add extraction for support info and rename getLanguageInfo function 2020-01-23 14:19:22 +01:00
B0pol
1a15c0e750 agelimit now returns 18 if the video is marked as nsfw, 0 otherwise 
+ created getBoolean method in JsonUtils.java
 2020-01-23 04:42:54 +01:00
B0pol
bcfe7be4e6
Merge branch 'dev' into peertube 2020-01-22 19:19:41 +01:00
Tobias Groza
b9afc9807c
Merge pull request #233 from Stypox/yt-stream-ext 
Youtube stream extractor improvements by using playerResponse json
 2020-01-20 23:17:36 +01:00
Tobias Groza
82eff772fa
Merge pull request #234 from TeamNewPipe/fix/YT_search_test 
Fix and improve tests
 2020-01-20 23:16:27 +01:00
Stypox
1cfdc4547a
Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/extractors/YoutubeStreamExtractor.java 
Co-Authored-By: Tobias Groza <TobiGr@users.noreply.github.com>
 2020-01-20 22:52:48 +01:00
Stypox
1e1100ef76
Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/extractors/YoutubeStreamExtractor.java 
Co-Authored-By: Tobias Groza <TobiGr@users.noreply.github.com>
 2020-01-20 22:52:36 +01:00
TobiGr
2308b074f0 [MediaCCC] Fix testGetTextualUploadDate() 2020-01-20 22:12:39 +01:00
TobiGr
089dbe8afb Fix StreamLinkHandlerFactoryTest by passing baseUrl to vdn.youtube urls 2020-01-20 22:10:18 +01:00
B0pol
f403490bd9
Refactoring 
Co-Authored-By: Tobias Groza <TobiGr@users.noreply.github.com>
 2020-01-20 21:28:26 +01:00
TobiGr
69ccb7e69d Update subtitle tests comments 2020-01-20 21:25:47 +01:00
TobiGr
7943130307 Throw IllegalArgumentException when url is null in LinkHandlerFactory 2020-01-20 21:25:16 +01:00
TobiGr
39de55dcd3 [YouTube] Fix and move streamCountTest 2020-01-20 21:24:51 +01:00
TobiGr
51fd9ba491 Merge branch 'master' into dev 2020-01-20 20:31:32 +01:00
bopol
ad7f97ae83 fix PeerTube description and add more description tests 
actually, the max description length is 250 after request with our extractor.
during my tests, I made API requests with Firefox, copy/pasted into echo "insert description" | wc, and it was giving a wrong length, maybe due to the escapers, I have no idea
anyway, it's now fixed
 2020-01-20 15:14:23 +01:00
bopol
b382416372 changed the way to extract peertube description 
if the description length is above 254, and ends with ..., it means the description we got from the first request is shortened.
why above 254: because in fact, shortened descriptions length are between 255 : https://framatube.org/videos/watch/24efbe1b-73c0-4d72-a3ff-77c8b32d3fcd
https://framatube.org/videos/watch/1ca99f40-fb5b-4fa4-abe5-4d54325df7fc
and 269: https://framatube.org/videos/watch/4d661d5f-a884-4510-bca8-15cb19aa3fe5

also fixed a typo in StreamExtractor.java
 2020-01-20 14:36:12 +01:00
bopol
a281519e77 added metadata, fix descriptions, fix thumbnail, update tests 
thumbnail: quality before: https://peertube.cpy.re/static/thumbnails/d2a5ec78-5f85-4090-8ec5-dc1102e022ea.jpg
quality after: https://peertube.cpy.re/static/previews/d2a5ec78-5f85-4090-8ec5-dc1102e022ea.jpg

description: we were getting about the first 260 characters, we now get full description (with fallback to first 260 chars if the get request for full description fails)
test: updated tests to match description, also changed some test: it was assertEquals(extracted, expected), but the proper way to do it is assertEquals(expected, extracted)

metadata: got host, privacy (public, private, unlisted), licence, language, tags
 2020-01-20 12:22:33 +01:00