No.2234
This is the thread for discussing improvements, fixes, additions and development of oyasumi-chyuu, a site made to house /qa/'s collection of OPs and EDs. Up until now I've been working on it on my own, but it was always intended to become a place that the community can develop together. I haven't asked for any help on it because I wanted to learn how to do things on my own, but now that it has most of the main features that I wanted to add its a good time to open it up. If it seems like a very basic site, thats because it is. I'll make a github soon enough so everyone can look at the actual files and help improve them as needed, but if theres something that you think needs to change and you know how to do it, by all means please help.
Theres a number of fixes I want to work on now but for now I want to focus on the development of a scraper. Its been suggested that we make a scraper that will pull information about a given OP from a site like anidb.net. The scraper will put the information into the post form for the user, so all they really have to do it select the file to upload, select which OP it is and hit Go. This will both minimize the chance for errors and wrong or inaccurate information entered, and will make uploading a series of videos from the same show much simpler. Aside from this, its also been suggested to make a scraper that will collect more information about the song used in each OP itself )such as the song name, artist) and display that. There are a couple other sites that have information on the complete soundtrack from different shows so we can pull from there. Plus, if we pull from those sites, it gives us a more accurate number of how many OPs and EDs a series has so we can collect them all. I haven't looked too deeply into this, so if theres anybody out there with any experience or who knows how to do this your help would be greatly appreciated!
No.2236
- If you're doing anything from an aspiring professional's perspective don't do it without some sort of framework.
- Even from the point of view of an amateur you shouldn't be writing the fundamental software code but improving/implementing with something already existing.
- Most people don't want to help with the back end unless you're from some sort of corperate background
No.2237
>>2236>If you're doing anything from an aspiring professional's perspectiveno no not at all, this is just for fun and something nice to work on and share. see the name?
its a lot so people probably wont want to touch it, but /qa/ has proven to be surprisingly skilled in a number of different fields so you never know
No.2238
what I would do then is look up if any of
https://dzone.com/articles/8-awesome-php-web-scraping-libraries-and-tools these are useful and use it to retrieve the data you want, then insert it into the database.
The template engine should build page based on the database entry and fill out the variables on the template. Vichan uses twig, laravel uses blade.
I've yet to learn laravel or symphony, but I'm planning on rewritting kissu to symfony when i'm done learning laravel. You could consider making your site run with that if you feel like that's a good use of time. Designing sites is much easier when you have an established system to work with
No.2239
I suppose you could do this clientside as well if there's a good idea on how to make it make sense
No.2241
>>2240aside from collecting and uploading OPs, there not much right that needs to be automated. dont worry, when something oes come up I'll be back to suck up all your free time. that being said, if i put out a list of series that we need the OPs for, would anybody be willing to start collection?
>>2238ill look into this when I get some time and will probably be back with questions, i dont know much about either of them. thanks for the help
No.2242
>>2241> if i put out a list of series that we need the OPs for, would anybody be willing to start collection?sure, that seems easy enough
No.2243
>>2241It's just a suggestion. Few people are writting the foundational aspects of websites nowadays and leave it in the hands of the people who are more interested in creating foundations than applications. Laravel and Symfony are examples of these. The benefit is that your project gets to be less focused on the site itself meaning spend more time adding features. Also readability and it's easier for people to contribute if they want
No.2244
Something you could think about for the future is marking which OP/EDs are creditless/BD quality and which are TV/Web rips. That way people could more easily provide better files for already existing OP/EDs
No.2245
>>2243another pro-programmer thing is unit testing. Look into PHPUnit. I'm only learning it now within laravel, but when you change something on your site you never know if it broke something else without manual testing. Instead of manually testing every time you can write your own tests you run whenever you make a change.
Laravel has a way that you can test what happens when a page is added without actually changing the site the users see.
No.2246
I think I might move this thread back to /b/ in a couple days, or it could remain on /qa/ as a non-sticky. I'm not sure what else people have to say...
No.2247
>>2238>I've yet to learn laravel or symphony, but I'm planning on rewritting kissu to symfony when i'm done learning laravel.I'm sure Symfony has its advantages, but please don't decide to do a rewrite in any framework until you understand concretely how it will reduce the complexity of the project. Remember Infinity Next; Josh thought rewriting 8chan's software in Laravel would improve its efficiency and maintainability, but it ended up more complex and less efficient than the original.
No.2248
>>2247Scalable and easy to update is the problem. Another framework is just means to stay modern. I've said it will only happen when I have design documents up and I'll probably do it using Test Driven Development practices.
The problem with vichan is it's written by hacks who don't even know how to put a database into 1st normal form, let alone add in a few unit tests. Jesus, why are they even using a relational database? Not to mention posts_qa, posts_b, posts_win. The abhorent design makes me regret having even touched this software.
Putting aside my contempt for Josh as developer of kiwifarms, for one he had to work over an egomaniac Brennan and actually made a pretty solid site when he wasn't with him. I'm lead to believe that the issues weren't him.
added, the blog post i've read about brennan's time working on Next strongly gives off negative vibes of the accusers character and not of the accused, who is a person who can't defend himself or tell his side of the story. In said blog, the accused is constantly treated as a druggy who gains weight. I don't think this is a fair characterization that tells a lot about the development process and is merely populism to try and sell brennan's credibility for failing to manage the project.
Laravel isn't supposed to be used on large scale websites. It's a prototyping tool. My research can't turn up any real usages of it. Symfony on the otherhand….
But overall the difference between Symfony and Laravel doesn't matter too much for a site of the size of oyasumi or kissu. The problem to me is that the custom writting of backend code is something that requires a group of people very experienced with software development and can see which way their tech stack is going. I would not be able to do it and the projects I have are not very good.
No.2249
and also yeah.. I need to use a better deployment method that doesn't make the git repository look like a spam folder.
The idea is for this to be planned out with coding happening as late into the cycle as possible. Won't be until 4taba's code is stable anyways.
No.2250
>>2244i thought about doing this a while back but ive been trying to streamline the upload process and reduce the amount of boxes you need to check or info you need to enter, because it may not seem like a lot but it builds up when entering hundreds of videos. plus i didnt think that it was too important, but since itd be easy enough to add then if thats what people want I'll put it in
>>2242I'll put out a list this weekend of stuff we have and stuff we dont have yet, thanks a lot. or, if youre up for a more monotonous task, theres always QCing the series that are all up
No.2251
Working on the list of Anime OPs we still need, I've been keeping track of things in my own spreadsheet here
https://docs.google.com/spreadsheets/d/1ZXCQk7C4R4uXoN2mqdFoRyVHbJaRbyryCJTS1lMp_fw/edit?usp=sharing but I'm going to try to make a better one, one with everything we need as opposed to only things that we have so far. Besides collecting existing OPs, the time we'll need the most help will be every time a new season starts.
There's one or two other problems that we're looking at right now but I won't get into them since solutions have either already been mentioned or just haven't been tried yet. Aside from that I'm thinking of moving the site over to a dedicated server. The only drawback from that would be that it requires a hosting plan with a lot of storage space; right now space is unlimited but as soon as a cap is put on the amount of space we can take up, you have to start worrying about file size and compressing videos. The benefit, however, would be being able to add more users that are able to access the actual files and move things around. Only having one account that can do that is bad, since in my absence nobody would have access and I'd like to prevent that. Tough call
One more thing to work on would be a post form. It's been disabled for a while because its not high priority and I don't think many people put lots of value into commenting on any of the OPs but I'd like the option to at least be there. The only thing left on it really would be to make prepared statements to prevent any XSS or somebody trying to submit something that they shouldn't.
Thats all I can think of right now, I'm sure theres more but I'll think of it later. None of it is high priority, it'll probably take a while to implement all the changes talked about here and I expect it to. Its a slow project but thats how its meant to be. Better that we build something good that will last a long time than rush something out ASAP
No.2252
I'm going to remove the stickiness, would you prefer it become regular thread here or a sticky on /b/?
No.2255
>>2252over on /b/ please, thank you!
No.2257
>>2253>>2254got 'em, thanks!
No.2269
We've had some issues with videos not playing or not having audio in different browsers (namely firefox) so I was looking into a fix for it but most of the answers I found said to install an add-on to firefox to get them to play. I think this is a bad solution because instead of working to fix it from the website's end, it means you'd be telling viewers that they need to fix it if they want to properly watch anything and its a problem on their end, which feels hostile and moreover lazy. The obvious solution would be to properly encode the video so that it works but this wont cover cases where somebody has several videos that they want to upload and are unaware of how it needs to be encoded to run in all browsers.
What I want is to have an ffmpeg extension so that videos can re-encode on upload and we wont have to worry about that problem. In addition we'd be able to get rid of the input for a thumbnail and have on generated from the video file, working to smooth out the process. Unfortunately since oyasumi isnt on a dedicated server theres no ffmpeg extension or support, and it would need to be moved over to one if I want to be able to use ffmpeg.
Does anybody know of an alternative or a work-around that would be able to do the same job? Namely I'd like something that will be able to create thumbnails to store from the video when it uploads. The encoding problem can be dealt with later really, the thumbnail issue seems simpler to fix and would be a more noticeable improvement
No.2270
never thought about it because i use vps, but probably just download one of the builds at(or whatever if you're not an ubuntu server)
https://launchpad.net/ubuntu/+source/ffmpeg/7:4.2.2-1build1 then instead of
ffmpeg do things it would be
location/of/build/ffmpeg do things No.2271
I think this would require you to run the makefiles which might not be allowed, but that's the general idea anyways... add it manually and if that doesn't work then find a way to add a package that does
No.2273
next idea that comes to my mind is if it can be run in a Docker environment and communicated with... Docker kind of is like a VM that runs inside of a server so you can get passed restrictions... I believe anyways...
I've never tried to get passed these limitations
No.2326
I know youtube gets around any possible problems with video via their player, but no idea how you'd get something similar set up on your site
No.2327
i think it's streaming over a socket connection, but shared hosts typically block incoming socket requests to make it impossible to make a streaming site
No.2338
>>2326i looked into it and youtube re-encodes all of their videos, something I could do but again it goes back to needing ffmpeg/an ffmpeg replacement. ive been looking at the ideas already posted here and am going to try installing something on my own, once im sure my host wont give me the axe for it..
No.2544
>>2338Re-encoding videos isn't really a completely practical solution unless you've got dedicated hardware. There's no "universal" setting to maintain quality, and encoding videos obviously takes quite a bit of time in and of itself. Likewise, if there's no hardware acceleration, encoding tends to take a [u]really[/u] long time. Case in point, WEBMs; a lot of hardware has no specific hardware acceleration for encoding WEBMs, so rendering a WEBM compared to a standard H.264 MP4, in my own experience typically results in an approximately hundred-fold decrease in speed.
No.2904
>>2338I was thinking on this, and something nice youtube has is that when you start to upload something it brings you to a page where it shows your uploads and them processing. So while that happens you can queue up another upload and then wait while everything uploads.
No.2914
replace the placeholder embed.php with a real player that links you to the original sources. Also I realized the best solution to FFMPEG is that you can have a local computer or laptop do the things your cheap server can't by passing requests to it. It slows things down a bit but it's not a time sensitive operation
No.2916
>>2914you mean something like this?
https://oyasumi-chyuu.fun/embed_backup.phpthis works on its own but doesnt seem to load when its embedded in kissu's homepage so im not changing it just yet. theres probably an easy fix for it though so itll be working soon enough
No.2917
>>2916i'll see if i can get it to work. I changed it to load as iframe instead of video
No.2918
I need you have the contents adjusted based on size(width or height) of the window. I changed it to default to your backup version
No.2919
please make it work relatively quickly because it's autoplaying a cropped up video right now.
Also allow a query to dynamically set if it autoplays or not
https://oyasumi-chyuu.fun/embed_backup.php?autoplay=1should allow autoplay
https://oyasumi-chyuu.fun/embed_backup.php?autoplay=0does not
No.2923
>>2919fixed, youll be able to query it now but if it doesnt work let me know
No.2933
some of your vids don;t autoplay so it;s kind of awkward to force opening the site on click.. also defeats purpose of autoplay off... whatever though
No.2938
>>2933ive been trying to find the reason for some of them not autoplaying but i havent found any consistency in the ones that do or dont, ill fix it when i do
No.2939
i know some browsers have blocked autoplay if the sound isnt muted but i dont think thats the problem either, not sure what youre using but i have it enabled on chrome and its still iffy as to whether a video plays or not
No.2941
did you change something?
No.2945
If you add `controls` to the list of attributes it would at least allow people to start and stop
<video autoplay="" loop="" controls="">
it's inconsistent across browsers. Some organizations see autoplay without mute as spammy, others don't care as much.
No.3565
Are you talking about like databases or HTML tables?
Client Javascript won't have anything for databases for that beyond
https://api.jquery.com/category/ajax/, but if you want to store data that's easily readable for javascript then you could write .json files to disc and serve them on request.
No.3569
>>3568line fetching the data, i think that this is the piece here that needs to be changed
$(document).ready(func
tion(){
fetch_data();
function fetch_data()
{
var dataTable = $('#user_data').DataTa
ble({
"processing" : true,
"serverSide" : true,
"order" : [],
"ajax" : {
url:"fetch.php",
type:"POST"
}
});
}
No.3625
>>3569Is there a reason you're doing this in Javascript instead of rendering the HTML server-side? Anyway, if you have a reason to do it client side, you should be able to do an AJAX request for fetch.php, then loop over the data it sends you to create whatever elements you want.
No.3695
Finally going to fix the comments, testing it out here. This will also double as a way to give feedback on oyasumi on the site itself, though ill still keep this thread up
https://oyasumi-chyuu.fun/blog.phpBeen doing random fixes and trying to unclunk the whole thing in general for the past few weeks, its slow progress but going pretty well. I'm also trying to think of where else to advertise besides kissu and a few other spinoffs, I'd like to see oyasumi get a little more traffic. A big part of that also means oyasumi needs to be made into something that people will
want to use and link to. We'll see how things go
>>3625>Is there a reason you're doing this in Javascript instead of rendering the HTML server-side?lack of experience. i managed to figure it out, thanks for the help
No.3864
Not really a question concerning the site, but more about the stuff I'd be uploading. Does anyone know how to locate just the NCOP/NCED in a raw BD disc release of an anime? I know most anime do have it somewhere in their DVD/BD releases, but not always do groups include those in releases, annoyingly.
No.3871
>>3864Depends what you mean by "raw BD disc release." Do you mean you have an actual disc, and/or the .iso or .ts that someone dumped? Or, do you just mean you've downloaded an entire raw anime (that's already been encoded, and is just missing the subtitles) and you're just trying to find the NCOP and NCED files?
No.3875
>>3871Maybe the entire raw anime which has been encoded? It's where the folder structure is set up like this. BDMV may be what I'm thinking of.
https://nyaa.si/view/1256238 No.3876
>>3864i dont think youll be able to search for the file specifically. what i usually do is when i find a BD that has NCOPs/EDs in it ill go to the uploader who put it on nyaa and search all BDs uploaded by them. ive found that they will pretty consistently always have NCOPs along with the rest of BD. example here
https://nyaa.si/user/Doki?f=0&c=0_0&q=BD No.5709
This thread hasn't been used in a while. Should it get unstickied?
No.5710
This sticky is my friend. It has been there for us during this tumultuous year. You would turn your back on it?
No.5784
Something that may be of interest is a little minigame that people could play on the site or something. That'd probably be fun to keep people coming back to the site more
No.5893
Stop using PHP. There, it's fixed.
No.5936
its been my fault for not being active lately and this sticky and the whole site has fallen into disrepair. ive been busy and have only had time for small things here or there but thats still not really an excuse..
thankfully i should have a bit more free time now to be able to actually work on things. i have a long list of suggestions that ive promised to work on. i have been thinking about something like this
>>5784 to keep interest up, maybe something along the lines of events that will draw people in? it all requires a bit more thought until it becomes a reality though. Of course, it all comes back to advertising being the easiest and most obvious way of keeping activity and interest up but i never feel like the place is really ready yet to start posting its name up everywhere (minus here)
>>5893i would but i dont have the experience to get it rewritten in anything better any time soon
so much work, so little time
No.6109
Most of the OPs for this season are uploaded so ive had some time to finish some work ive been putting off
the search bar is fixed, and by fixed i mean not garbage now. it took a little playing around with the sql request, it was only matching full words for the longest time which is why it would more often than not give no results. changed it from only matching fulltext and full words to searching for full and partial spelling in all fields and then sorting results by relevancy. partial titles, localized and romanized names are all included now. Also, i dont know if anybody knew this but you can also search in 日本語 and itll work, if anyone was wondering
Added parameters to the random video page. You can now adjust random video requests by OP/ED, Year and Season and itll pull from that pool. Its up and working but if you send a request for something it doesnt have (i.e. if you request EDs from Fall 1962 and there are none) itll give you an error. Its an easy fix and ill get on it in a day or two, i just didnt feel like doing it tonight. This is mostly a test to see how something like this would go, and im going to apply it to the main page for videos next
which leads me to the next thing im going to work on, which would be an adjustable queue of videos that will autoplay, meaning you can set the year to 2016 and itll run through every single OP from 2016, or set it to a certain series and itll run through all videos from the series. Somebody asked me to make one a few months ago and i mostly finished it, i think the two problems i ran into were 1. how to keep the video queue constantly pulling new videos and 2. how exactly to define "related" videos
I guess this means i need to get around to finally uploading more info about the songs, studios and singers themselves but thats a big job so ill have to start it some other time
No.6124
>>2234Have you seen this repository?
I access this IB and noticed that in his commit, there is a reference to you, what do you think?
https://github.com/27chan/bazukachan/commit/faf200f36cef7b1b1ad281ea6511b1a2487945dd No.6129
>>6124where he thanks Echibiki at the top? Im not vern, but hed probably be happy to see his work get used
No.6192
can you readd the "previous" and "next" button at the bottom of the index?
I don't want to snipe for a small number each time I want to go back a page
No.6238
I didn't see a link to this thread anywhere on the website? I signed up (under roa), how can I help?
No.6279
When you press return from the report function it sends you to the mod login page
No.6282
wrong thread
No.6527
!sticky off
No.6553
>>6238I appreciate you wanting to help, the best thing now is to just find new OPs and uploading them. If you need help i can put some more stuff in this thread for cutting and converting OPs, we're going to need all the help we can get since the start of the next season is coming around
Right now im trying to work on something but my schedule is very prone to change, so the biggest barrier is that i will begin working on something and then have to stop midway, then come back once ive forgotten what i was doing and then muddle my way through old stuff i wrote. right now im trying to fix the very very broken mod/user system i made a year and a half ago, so if i get it working then that will be extremely useful and more people will be able to work on and update things live on the site as opposed to having to get into all the sql. until then, just uploading OPs you find would be the biggest help. sorry its taken me an entire month to get back to you
mashiro if youre out there, i made that queue thing you suggested, its just not on oyasumi yet because its too bare bones to be of much use or function as smooth as it could be
No.6554
>>6553> mashiro if youre out thereyes, keep up the good work!
No.6575
>>6553What's breaking on your queue idea?
Is the concept that it autoplays videos from a list when you're on a certain page?
No.6584
>>6575its less breaking than it is not done. im stuck on how to generate related videos. ideally i would add a list of artists and studios to each op, then generate related videos based off of those selectors + anime in the same series but adding that to the already existing db will take a long time. rather than having any problems writing anything, i guess its more finding the time to do it than anything
No.9634
Noticed "2022" and "20212" and "2021" under the years tab don't seem to be working for me. Also "Currently Airing" is a mix of a few Summer 2021, Fall 2021, and Winter 2022.
No.9635
seems like this thread's images vanished. I can replace them with anything else if you post it here
No.9976
My ideas:
Advanced Search
Search: [...] (with predictive search)
Currently Airing? [X]
X Season: [Spring, Summer, Fall, Winter]
X Year: [2015, 2016, 2017, ...]
[Search] [Help Me Choose! (Random Option)]
(And the results could be a table with sortable headers.)
If you want to help us fix any incorrect video information or just want to see an OP/ED not on Oyasumi, let us know [here].
Video thumbnail view when browsing.
Uncenter Login/Sign Up links.
No.9981
Include: [Both OPs and EDs, Only OPs, Only EDs]
No.9993
>>9992oops I didn't mean to reply to anything
No.11862
oyasumi site 404s now
No.11863
>>11862Ah, yeah, well the guy's been busy in RL or something from what I've heard. It might come back someday...
No.11864
>>11862It works for me. Try http://