Forum - View topicOne and only release scraper issues thread
|
Goto page Previous 1, 2, 3, 4 Next |
| Author | Message | |||
|---|---|---|---|---|
|
BigOnAnime
Encyclopedia Editor
 Posts: 1225 Location: Minnesota, USA |
|
|||
|
So in other words, adding releases is now pretty much impossible, yay. I sent Dan42 a PM about the release scraper recently, hopefully it gets hit attention, but he hasn't posted in a week now, so who knows when we'll see any of these issues get fixed.
|
||||
|
||||
|
Shiroi Hane
Encyclopedia Editor
 Posts: 7580 Location: Wales |
|
|||
|
It occurs to me that this may be down to the other site issues; something related to the change of URL etc. may have triggered anti-DOS measures on the sites in question.
|
||||
|
||||
|
Calico
Posts: 383 |
|
|||
|
Is everyone else still having problems adding releases, even after the domain has been recovered? I've been trying to add some releases using Barnes & Noble and Amazon, but neither have been working for me.
|
||||
|
||||
|
horseradish
Posts: 574 Location: Bay Area |
|
|||
|
^Calico
As BigOnAnime said a couple posts ago, adding releases is now pretty much impossible for regular contributors. I still get "could not fetch page" and "not a valid page" errors, which is unfortunate since missing releases are growing. 
|
||||
|
||||
|
BigOnAnime
Encyclopedia Editor
Posts: 1225 Location: Minnesota, USA |
|
|||
|
Looks like I'll have to shoot Dan another PM and hope he reads it (he seems to not have read the one I sent a month ago), or attempt to post in the "Bugs & Technical Questions" section of the forum as he seems to not be looking at this section.
|
||||
|
||||
|
Calico
Posts: 383 |
|
|||
|
@horseradish Well, that sucks. I guess we just have to wait and hope someone with the power to do something will actually fix it.
|
||||
|
||||
Kruszer
 Posts: 7983 Location: Minnesota, USA |
|
|||
If the release has an encyclopedia page you can actually add a sort of place-holder entry to your own collection list to help you keep track of some of what's missing by using the drop down boxes. It won't add anything to the ANN Encyclopedia though just your list. For DVDs/BDs you could always try FilmAF |
||||
|
||||
bglassbrook
 Posts: 1243 Location: Gaithersburg, MD |
|
|||
|
*rises from the grave and looks around*
Well... phooey. Since it doesn't look like there's been much discourse in over a year at this point, are releases officially dead-for-good (at least until 2.0,) or does functionality come-and-go, and maybe things will work better when retailers aren't getting slammed by Black Friday traffic?
Ah, yes... good reminder. |
||||
|
||||
|
BigOnAnime
Encyclopedia Editor
Posts: 1225 Location: Minnesota, USA |
|
|||
|
This needs to be added.
https://www.rightstufanime.com/Natsumes-Book-of-Friends-Season-3-Standard-Edition-BD-DVD anime#12542 Also is it alright if I request the adding of many of the missing releases since the scraper broke in summer 2017, and point out the newer ones as solicitations from the various publishers come out? With RightStuf delisting many releases when they're no longer available, adding them properly will prove to be a bit more challenging when the scraper eventually gets fixed (can't believe it's already been almost two years since it broke). [Edit]This needs to be linked to these two releases. anime#4308 release#17592 release#20892 |
||||
|
||||
|
IúkaSylvie
Posts: 79 Location: Kyoto, Japan |
|
|||
|
The Adventures of the Little Prince (anime#1360)
The Adventures of the Little Prince: The complete English language series: https://www.amazon.com/dp/B075L67RX2 https://www.barnesandnoble.com/w/dvd-adventures-of-the-little-prince-tv-series/31792108 https://www.rightstufanime.com/The-Adventures-of-the-Little-Prince-DVD The Beast Player (manga#21170) release#35555: https://www.amazon.com/dp/1782691677 release#35556: https://www.amazon.com/dp/B078955C3K The Beast Player [hardcover]: https://www.amazon.com/dp/1250307465 https://www.barnesandnoble.com/w/the-beast-player-nahoko-uehashi/1127456021#/ Chargeman Ken! (anime#1242) Chargeman Ken! The Complete Series: https://www.amazon.com/dp/B075KZC466 https://www.rightstufanime.com/Chargeman-Ken-DVD Fullmetal Alchemist (manga#2565) release#26322: https://www.amazon.com/dp/B00JDRKY48 release#35696: https://www.amazon.com/dp/1974703797 https://www.barnesandnoble.com/w/the-complete-art-of-fullmetal-alchemist-hiromu-arakawa/1128170827#/ https://www.rightstufanime.com/The-Complete-Art-of-Fullmetal-Alchemist-Hardcover Moribito (manga#16161) release#26916: https://www.amazon.com/dp/B00JWGOPZE release#26917: https://www.amazon.com/dp/B00JWGOPUY |
||||
|
||||
|
IúkaSylvie
Posts: 79 Location: Kyoto, Japan |
|
|||
|
The Beast Player (manga#21170)
The Beast Warrior [hardcover] (Novel 2): https://www.amazon.com/dp/1250307481 https://www.barnesandnoble.com/s/9781250307484 The Beast Warrior [paperback] (Novel 2): https://www.amazon.co.uk/dp/1782692401 The Beast Warrior (eBook 2): https://www.amazon.com/dp/B084V1ZTYK https://www.barnesandnoble.com/w/?ean=9781250307491 |
||||
|
||||
|
IúkaSylvie
Posts: 79 Location: Kyoto, Japan |
|
|||
|
The Legend of Dororo and Hyakkimaru (manga#22779)
The Legend of Dororo and Hyakkimaru (GN 1) https://www.amazon.com/dp/1645056376 The Legend of Dororo and Hyakkimaru (eBook 1) https://www.amazon.com/dp/B0872SD9RS The Legend of Dororo and Hyakkimaru (GN 2) https://www.amazon.com/dp/1645057607 The Legend of Dororo and Hyakkimaru (GN 3) https://www.amazon.com/dp/1648271006 |
||||
|
||||
|
BigOnAnime
Encyclopedia Editor
Posts: 1225 Location: Minnesota, USA |
|
|||
|
Bumping this to make people a bit more aware of things. Early last month Dan got the scraper partially fixed. A breakdown of things:
RightStuf: -Works for books and discs -Doesn't pull description -Doesn't pull MSRP (was making stuff up out of thin air) -Doesn't recognize combo packs or dub/sub-only releases (The former isn't much of an issue anymore given the industry has largely shifted to Blu-ray-only releases) Barnes & Noble: -Works ONLY for books, discs do not work -Pulls description -Doesn't pull MSRP So regular users are now able to add releases again, but only if they're using a RightStuf link or a Barnes & Noble link for books, none of the other stores work. Also a recommendation with books, use only a RightStuf link, and then after the release is created, enter the Barnes & Noble link, and it'll automatically get the description and page count in right away. v_i and I also spent a ton of time trying to fill that hole of missing disc releases as the scraper broke in mid-2017. Nearly all non-hentai 2021 and 2020 anime releases should be in. If anyone wants to help fill the 2017-2019 gap, feel free to do so. Also if someone could really focus on manga and light novels, that'd be great as I sadly don't follow those releases much. Hentai is going to be much more difficult to fill that gap as the main issue is the encyclopedia doesn't have the series pages made for them much anymore, so they have to have a page created first, then releases can be added. |
||||
|
||||
|
BigOnAnime
Encyclopedia Editor
Posts: 1225 Location: Minnesota, USA |
|
|||
|
Update:
All non-hentai 2017, 2018, and 2019 releases should now be in save for stuff with no UPC as only admins have the power to add releases without a UPC or ISBN. Oh and Nutcracker Fantasy from Discotek as there still isn't an encyclopedia page for it, that'll be fixed soon. After 4 years of the scraper being broken and there being tons of missing releases as a result (around at least 1,500 going by where I started (release#36613) and what I most recently added (release#38609)-not everything recently added was 2017-present disc releases), the hole is finally nearly completely plugged. If anything needs correcting or there's something missing which has to be manually added (not currently on RightStuf if it's a disc release), I'd recommend posting in the Release Corrections thread with the UPC. I'll soon work on dealing with missing hentai releases. If anyone wants to help out, feel free to do so, just be aware they're currently harder to add as the main issue is the encyclopedia pages haven't been added for many of them. |
||||
|
||||
|
BigOnAnime
Encyclopedia Editor
Posts: 1225 Location: Minnesota, USA |
|
|||
|
Another update:
The Barnes & Noble and DVD Empire scrapers got fixed recently for disc releases. Amazon is still broken, but should hopefully get fixed in the coming months. Once the Amazon scraper is working again, anything delisted everywhere but Amazon can be added again, with VHS tapes being a big one as that's an area where the encyclopedia is missing tons of releases, especially as most of those predate the site. Older manga would then be able to be added as well as I've noticed some rather old releases were missing (Ex: Bastard!! Volumes 1-6) which I've since added manually. Also, all 2011-present hentai releases should be in, so that hole is finally plugged. |
||||
|
||||
 |
All times are GMT - 5 Hours |
|
|
|
Powered by phpBB © 2001, 2005 phpBB Group