This script is intended to be used on the following BiliBili pages: Note: It is reccommended that to include '&' in any of the argument that the entire argument gets enclosed in quotes or double quotes. q, -quiet Limit the information printed onto the console as the script executes a, -append Scrape links to an existing csv file p, -page Select specific page(s) to scrape Prevent links from being extracted on same page as w, -wait The amount of second to stop and wait for browser to load. p, -save The user's chosen absolute save path for the csv file h, -help show this help message and exit The file is temporary and will probably be removed after a little more progress on the link scraper script. This executable file does not involve command line arugments, thus making it easier to use. The executable file in the repository is a basic demo version of the current link scraper script. It should be noted that the default ouput for the csv file will be in the same folder as this script. It is also recommended that the ChromeDriver is installed and placed in the same folder as this script as there would be no need to specify the driver path later on. ChromeDriver which is required to work with Selenium, and ensure you're downloading the version that matches your Chrome build.Note it is recommended that pip is installed and/or up to date. A requirements text file will be included and the command pip3 install -r requirements.txt (or pip)can be used to install the required modules(also ensure that python was installed on path if errors involving pip pops up).Therefore, the following needs to be installed:
ChromeDriver is also required to navigate through BiliBili. This script requires non-standard modules: requests, BeautifulSoup, and Selenium. The csv file can be used by annie or youtube-dl(not recommended as youtube-dl doesn't download all parts of the video) to download every single video with the given url in the csv file. Rather than right clicking each video in order to obtain its url, this script is designed to allow users to obtain all the video urls from each page and writing all of that into a csv file.
Currently it is able to scrape all video links from search result pages, user's 投稿(submissions) pages, and user's 频道 (channel) pages. The design can easily be modified to support other Camera Link devices or other FPGA development platforms.This is a simple script that scrapes all the video urls from certain BiliBili pages. The design is built around Altera’s video IP framework and demonstrate 24-bit RGB frame capture, video scaling, the use of camera control signals and serial communication. (Contact sales regarding support for Altera Dev Kits.) The design example supports a Frame Grabber Base configuration using a Camera Link digital camera as the input and outputting the RGB video data to a HDMI monitor using the Microtronix HDMI 1.3 Transmitter Daughter Card. The Camera Link Frame Grabber Design Kit comes complete with Quartus reference design for the Microtronix ViClaro III (Cyclone III) Dev Kit. The kit includes a 1-year OpenCore Plus Developer (evaluation) License for the Microtronix Camera Link Transceiver IP core. The Design Kit consists of a Camera Link Receiver Daughter Card, the Gigabyte Ethernet PHY/HDMI 1.3 Transmitter Daughter Card and a MDR-26 or SDR Power over Camera Link cables (optional) for connecting peripheral devices.
The Microtronix Camera Link Frame Grabber Design Kit targets designers building vision systems incorporating Camera Link™ communication interfaces.
0 kommentar(er)
