https://wiki.anidb.net/api.php?action=feedcontributions&user=JaLooNz&feedformat=atomAniDB - User contributions [en]2024-03-28T14:33:18ZUser contributionsMediaWiki 1.40.0https://wiki.anidb.net/index.php?title=Avdump2&diff=17062Avdump22013-02-03T10:22:38Z<p>JaLooNz: /* MS-DOS Batch File */</p>
<hr />
<div>Welcome to the remarkably sparse avdump2 wiki page, lovingly hand created over many minutes + some more.<br />
<br />
We gleefully embrace build 6525, yet another public release of avd2. It represents a complete rewrite of the original avd1 code, runs against a new build of MediaInfoLibrary, contains a number of custom solutions for a number of formats, represents a significant investment of time and energy by Arokh, and is just generally nifty.<br />
<br />
There is no need to reprocess existing files with this build, but do keep an eye out for misbehaviour.<br />
<br />
==What is it==<br />
'''Avdump2''' is a video/audio codec identification utility - identifies which video codec and audio compression method is used on video files. Furthermore it hashes the file with a set of common hashalgorithms and calculates the used bit rates, the length, identifies the number of used audio channels and more.<br><br />
It, like its predecessor, is mainly based on [http://mediainfo.sourceforge.net/en mediainfo], but significantly enhanced and changed to fit AniDB's needs by [[User:Arokh|Arokh]].<br><br />
<br />
===Supported formats===<br />
Most major file formats are supported to some degree. While hashes are created for all file types, stream details remain shakey for others (notably 'swf'). Because of that for some filetypes (underlined) only the hashes get auto-creqed.<br />
<br />
* '''Video files:''' asf/wmv, avi, flv, m2ts, mk3d, mkv, mov, mp4, mpg/mpeg, ogm, ogv, qt, rm/rmvb, <u>swf</u>, ts, webm<br />
* '''Subtitle files:''' ass, idx, js, lrc, mks, pjs, rt, smi, srt, ssa, sub, sup, tmp, tts, txt, xss<br />
* '''Audio files:''' aac, ac3, dts, dtshd, flac, m4a, mka, mp3, ogg, ra, thd, wav, wma<br />
* '''Archive files:''' <u>7z</u>, <u>ace</u>, <u>rar</u>, <u>zip</u><br />
* '''Linker files:''' mkv, smil<br />
<br />
===Download===<br />
<br />
[http://static.anidb.net/client/avdump2/avdump2_6525.rar DOWNLOAD(RAR)] (Build 6525) MD5 = e83a8e5afedd1e34e766daeb6d64d2d2<br />
<br />
===Usage===<br />
'''Avdump2''' is a simple [[Wikipedia:Command line interface|command line]] client:<br />
:<tt>AVDump2CL.exe [--<Arg> -<OneLetterArg> ...] <media file/folder> [<media file/folder> ...]</tt><br />
<br />
While pre 4991 build arguments can still be used, it is recommended to use the new format shown below.<br />
The easiest way to convert them to the new format is to run the program with the old args which then displays a notice and the corresponding args in the new format.<br />
<br />
====Options====<br />
{|align="center" style="border: 1px solid #aaaaaa; border-collapse: collapse; background: #f9f9f9; line-height: 1.0; font-size: small; width: 95%"<br />
! style="border: 1px solid #aaaaaa; background: #f2f2f2;" | Switch<br />
! style="border: 1px solid #aaaaaa; background: #f2f2f2;" | Type<br />
! style="border: 1px solid #aaaaaa; background: #f2f2f2;" | Description<br />
! style="border: 1px solid #aaaaaa; background: #f2f2f2;" | Default<br />
! style="border: 1px solid #aaaaaa; background: #f2f2f2;" | Example<br />
|-<br />
|'''Auth'''=<username>:<udp_api_key>||Auto-Creqing||Enable automatic creqing. You should always use this option when dumping anime files! Also enables error reporting.||||--Auth=tard:monkey<br />
|-<br />
|'''Host'''=<hostname>:<port>||Auto-Creqing||Hostname of AniDB UDP API server||--Host=api.anidb.info:9002||<br />
|-<br />
|'''LPort'''=<port>||Auto-Creqing||Local UDP port used for autocreqing. Only needed when behind "strict" firewalls.||||--LPort=12345<br />
|-<br />
|'''TOut'''=<timeoutInSeconds>:<numOfRetries>||Auto-Creqing||Timeout for sending dumps||--TOut=10:3||--TOut=25:6<br />
|-<br />
| &nbsp;<br />
|-<br />
|'''ACErr'''=<file path/name>||Logging||Write file paths of failed dumps to file.||||--ACErr=acerr.txt<br />
|-<br />
|'''CRCErr'''=<file path/name>||Logging||Checks if filename contains calculated crc||||--CRCErr=crcerr.txt<br />
|-<br />
|'''ExtDiff'''=<file path/name>||Logging||Write mismatched extensions and file paths to file.||||--ExtDiff=extdiff.txt<br />
|-<br />
|'''FixExt'''=<file path/name>||Logging||Changes the fileextension to the dectected extension and logs the action.||||--FixExt=fixext.txt<br />
|-<br />
|'''Done'''=<file path/name>||Logging||Skip paths present in log and append paths to newly processed files.||||--Done=done.txt<br />
|-<br />
|'''HLog'''=<file path/name>||Logging||Export hashes to file.||||--HLog="$CRC$ $ED2K$":hlog.txt<br />
|-<br />
|'''Log'''=<file path/name>||Logging||Write output to file.||||--Log=log.txt<br />
|-<br />
| &nbsp;<br />
|-<br />
|'''M'''||Output||MediaInfo dump||||-M<br />
|-<br />
|'''m'''||Output||MediaInfo XML dump||||-m<br />
|-<br />
|'''t'''||Output||Simple text format||||-t<br />
|-<br />
|'''C'''||Output||XML creq format||||-C<br />
|-<br />
|'''c'''||Output||AVD2 creq dump||||-c<br />
|-<br />
|'''h'''||Output||Hash Dump||||-h<br />
|-<br />
| &nbsp;<br />
|-<br />
|'''BSize'''=<KB_per_block>:<number_of_blocks>||Control||Buffer size for hashing.||||--BSize=512:16<br />
|-<br />
|'''Ext'''=<comma separated list>||Control||Comma separated extension list. Prepend with "-" to exclude. ||Process all supported extensions||--Ext=avi,mkv or --Ext=-zip,-sub or --Ext=*<br />
|-<br />
|'''Mon'''=<seconds>||Control||Monitor sleep duration in seconds.||--Mon=60||--Mon=120<br />
|-<br />
|'''NoErr'''||Control||Disable error reporting. You should not disable this as it helps finding and fixing bugs.||||--NoErr<br />
|-<br />
|'''R'''||Control||Do '''not''' recurse into subfolders.||||-R<br />
|-<br />
|'''p'''||Control||Pause when done (hold cmd window).||||-p<br />
|-<br />
|'''P'''||Control||Pause after each file.||||-P<br />
|-<br />
|'''r'''||Control||Random file order.||||-r<br />
|-<br />
|'''q'''||Control||Suppress progress (silent).||||-q<br />
|-<br />
|'''B'''||Control||Test pure hashingspeed without io limitations||||-B<br />
|-<br />
|'''U'''||Control||Use UTF8 as console output stream||||-U<br />
|-<br />
| &nbsp;<br />
|-<br />
|'''0'''||Hashing||For CRC (because the CRC of a 0 byte file is 00000000).||||-0<br />
|-<br />
|'''1'''||Hashing||For SHA1 (because of the 1).||||-1<br />
|-<br />
|'''2'''||Hashing||For ED2K (because of the 2).||||-2<br />
|-<br />
|'''3'''||Hashing||For Tiger (because a tiger in the house minimizes the Three Great Risks -- thieves, fire, and evil spirits).||||-3<br />
|-<br />
|'''4'''||Hashing||For MD4 (because of the 4).||||-4<br />
|-<br />
|'''5'''||Hashing||For MD5 (because of the 5).||||-5<br />
|-<br />
|'''6'''||Hashing||For TTH ... because that's what's left :p||||-6<br />
|-<br />
|'''a'''||Hashing||All (available) hash algorithms.||||-a<br />
|-<br />
| &nbsp;<br />
|-<br />
|'''Exp'''=<file path/name>||AniDB||Export ed2k-links to the specified file. Very useful when mass adding files.||||--Exp=ed2k.txt<br />
|-<br />
|'''PrintEd2kLink'''||AniDB|| ||||--PrintEd2kLink<br />
|-<br />
|'''PrintAniDBLink'''||AniDB|| ||||--PrintAniDBLink<br />
|-<br />
|'''OpenAniDBLink'''||AniDB|| ||||--OpenAniDBLink<br />
|-<br />
|}<br />
<br />
====Windows Shortcut====<br />
#Extract Avdump to a folder of choice.<br />
#:Example: <tt>"C:\Program Files\AVDump2\"</tt><br />
#Right-click <tt>AVDump2CL.exe</tt>, select ''Create Shortcut''.<br />
#Right-click the shortcut, add options to the ''Shortcut - Target'' line.<br />
#:Example, normal usage: <tt>"C:\Program Files\AVDump2\AVDump2CL.exe" -p</tt><br />
#:Example, auto-creq usage: <tt>"C:\Program Files\AVDump2\AVDump2CL.exe" --Auth=''myName'':''udp_api_key''</tt><br />
#::You can also set other options from the list above if you wish to do so.<br />
#::A commandline option to export ED2K links to a file is by adding <tt>--Exp=''C:\Path\ed2k.txt''</tt>, etc.<br />
#::Note that you need to set an '''UDP API Key''' in your AniDB profile for auto-creqing.<br />
#:Optional: Change ''Run'' to ''Maximized''.<br />
#Drag and drop any media-file onto the shortcut.<br />
<br />
{{eyecatch|Note|'''The ''udp_api_key'' is not your user password!!! see [[Avdump#Auto-creqing|Auto-creqing]] .}}<br />
<br />
====Send to====<br />
#Move the shortcut created above to the SendTo folder.<br />
#:Example, under XP: <tt>"C:\Documents and Settings\''Username''\SendTo"</tt><br />
#:Example, under Vista: <tt>"C:\Users\''Username''\AppData\Roaming\Microsoft\Windows\SendTo"</tt><br />
#::Where ''Username'' is your Windows Login-Name.<br />
#:Note that ''SendTo'' is a hidden folder.<br />
#Right-click any media-file, go to "Send To", choose <tt>AVDump2CL.exe</tt><br />
#Get [[Creq|CReqing]]<br />
<br />
====MS-DOS Batch File====<br />
#Extract Avdump to a folder of choice.<br />
#Create a MS-DOS batch file with the 2 lines below, and save it as ''filename.bat''.<br />
#<tt>@ECHO OFF</tt><br />
#<tt>C:\Program Files\AVDump\AVDump2CL.exe %* --Exp=''C:\Path\ed2k.txt'' --Auth=''myName'':''udp_api_key''</tt><br />
#Drag and drop any media-file onto the shortcut.<br />
<br />
{{eyecatch|Note|'''The ''udp_api_key'' is not your user password!!! see [[Avdump#Auto-creqing|Auto-creqing]] .}}<br />
<br />
==Changes From Avdump Classic==<br />
<br />
* AVD2 now runs on the managed .net platform. This will not affect most, as .net comes pre-installed with current versions of windows. XP or older may have to install the platform manually. While it has been tested on mono, such testing has not been exhaustive. We would be very interested in hearing how it behaves in such an environment.<br />
* While most command line parameters remain the same, there are some exceptions. <br />
** The "-o" parameter is no longer available in avd2.<br />
** The "-n" parameter is no longer available in avd2.<br />
** The meaning of the numeric parameters has changed.<br />
* In the event of an internal error, AVD2 ''will'' submit an error report back to AniDB. The error report contains no user-details (see sample), but ''is'' attached to the user name supplied with the -ac parameter. While error reports are ''only'' submitted if -ac is specified, they can be disabled by the addition of the -noerr parameter. That said, for the purposes of initial testing, we respectfully request that error reports not be disabled, so bugs can be found and fixed.<br />
<br />
====Sample Exception Report====<br />
<FileExceptions><br />
<Information><br />
<AVDump2CLVersion>0.1.3734.0</AVDump2CLVersion><br />
<RunOnBitness>64</RunOnBitness><br />
<OS>Microsoft Windows NT 6.1.7601 Service Pack 1</OS><br />
</Information><br />
<Exceptions><br />
<AVDump2CL.Exceptions.AVD2Exception thrownOn="20110303 05.27.26.9254"><br />
<Message>Error in DisplayBuffer</Message><br />
<System.ArgumentOutOfRangeException><br />
<Message><br />
Non-negative number required.<br />
Parameter name: totalWidth<br />
</Message><br />
<StackTrace><br />
<Frame><br />
at System.String.PadHelper(Int32 totalWidth, Char paddingChar, Boolean isRightPadded)<br />
</Frame><br />
<Frame>at l.a(f A_0, Progress A_1)</Frame><br />
<Frame>at l.a(f A_0, Dictionary`2& A_1)</Frame><br />
</StackTrace><br />
</System.ArgumentOutOfRangeException><br />
</AVDump2CL.Exceptions.AVD2Exception><br />
</Exceptions><br />
</FileExceptions><br />
<br />
===Avdump2 on Linux===<br />
Thanks to Mono, Avdump2 runs natively on Linux as well. However, as most development effort goes into the Windows version and due to the heterogenity of Linux distributions, running Avdump2 on Linux isn’t as straightforward as running it on Windows. All Linux-related usage notes can be found on the [[Avdump2 on Linux]] page.<br />
<br />
<br />
==Auto-creqing==<br />
[[Image:Autocreq.gif|thumb|Simple diagram of the way auto-creqing with Avdump2 works]]<br />
<br />
Avdump2 is the AniDB [[auto-creqing]] system. Some more or less important notes:<br />
* To be able to use this feature you’ll need an AniDB account '''and you have to define the ''UDP API Key'' in your [[profile]]'''. All data sent to the server will be logged with IP and uid.<br />
* It is possible to run more than one instance of Avdump2 at once, but not more than ten will work OK. At the moment ''only 10 sessions per ip are allowed by the server'', meaning the eleventh instance will terminate the first.<br />
* There is no direct connection between data sent to AniDB and creqs generated. The data received will just be stored for later processing. There is no way to check the current status for a dump. Usually, it should take ''at least 24 hours'' from the moment you dump a file till the data actually changes. If any irregularities occur, or when there is too much data pending, it will take more time.<br />
* The creqs generated will report the user who sent the data first (for a specific file) as the creqer.<br />
* You may dump files currently not in the database. The data is still stored and will be used later if/after the file has been registered.<br />
* Files creqed by the new system will be locked, meaning some fields will not be possible to change. Notify a moderator if you are '''sure''' that some of the data locked for a specific file is wrong.<br />
<br />
===Why didn't this file get dumped?===<br />
* The file in AniDB is registered with wrong size and/or ED2K hash.<br />
* The package never reached the server.<br />
* The decryption or decompression failed at server side (rare).<br />
* The dump is not valid XML (rare).<br />
<br />
===Why isn't this file verified?===<br />
Even if the file is dumped it doesn't mean it will get auto-creqed (and verified). Here are the reasons:<br />
* The file is corrupt/invalid ([http://anidb.net/perl-bin/animedb.pl?show=avmf&do=xml&avid=76226 example]).<br />
* The provided data is considered "incoherent". (Indicates a bug in Avdump.)<br />
* The dump was marked unfit for file verification by an AniDB Moderator.<br />
<br />
<br />
==Known issues==<br />
* In some cases MediaInfoLib (MIL) used by Avdump2 might report an audio stream to have 0 or 3 channels.<br />
* Anamorphic .asf/.wmv and .mpg/.mpeg files might not get detected correctly and will report the PAR instead of the DAR.<br />
* Some corrupted mkv files may throw a (Thread Aborted) exception, this will be fixed once the updated version of the mkv parser is introduced<br />
<br />
==Changelog==<br />
<div style="height: 280px; overflow: auto; padding: 3px; border:1px solid #AAAAAA; font-size: small"><br />
<br />
'''0.1.6525.0 : 2012.11.??'''<br />
* Reuse datablocks in an attempt to fix OOM issues on 32 bit linux (=> also more stable mem usage on all platforms)<br />
* Changed Naming: Password to API Key to avoid confusion (Ommina)<br />
<br />
'''0.1.6489.0 : 2012.10.??'''<br />
* Accept extensionless files when --Ext=* is used<br />
* Added disabled client exception<br />
* Fixed NullExcpetion bug (Invalid program hashes)<br />
<br />
'''0.1.6452.0 : 2012.09.??+x+y+z'''<br />
* Added notice when the test acreq had an invalid format<br />
<br />
'''0.1.6435.0 : 2012.09.??+x+y'''<br />
* Removed "log" extension from acreqable extensions<br />
* Added Framework Node in error reports<br />
* Added MIL filesize sanity check<br />
<br />
'''0.1.6361.0 : 2012.09.??+x'''<br />
* Changed BlockConsumer error message to state more clearly if the ACReq was sent or not<br />
* UTF8 for Error messages<br />
<br />
'''0.1.6359.0 : 2012.09.??'''<br />
* Moved to git repository<br />
* Changes lost in the ether<br />
<br />
'''0.1.6248.0 : 2012.08.28'''<br />
* Shiny icon for the executable<br />
<br />
* New AniDB Communication, should be faster and more reliable.<br />
** Big file reports no longer fail to be ACReqed.<br />
** Wrong Version and Wrong UserName/Password errors are now separated<br />
** Update notification will be shown if a newer version is available<br />
<br />
* InfoProvider:<br />
** Trimming all value fields<br />
** Fixes serverside parsing errors<br />
<br />
* FileExtensionProvider:<br />
** Limit ReadLine length<br />
** Fixes errors which can happen when a binary file is parsed<br />
<br />
* <strike>Directory: Added workaround for "too long" filepaths</strike> <br/> FileAdding: On error, display the path of the causing file/directory<br />
<br />
* MatroskaParser:<br />
** Less strict with corrupted mkv files. <br/> (If enough data could be read, the ACReq will be sent despite errors)<br />
<br />
* FileSource: Fixed nullpointer excpetion<br />
<br />
* CL:<br />
** Shortcut for DoneLogFileNameOnly is now D instead of R (because it clashed with NoRecurse)<br />
** Added version check and notification of new version if present<br />
** Less jumping for the ETA display<br />
<br />
* Added extensive tracing (removed in public versions)<br />
<br />
* Lots of other small things<br />
<br />
'''0.1.5290.0 : 2012.05.12'''<br />
* Fixed FileExtensionParser (hopefully)<br />
* TXT Report should be fixed now<br />
* Fixed ACReq Send Thread crash<br />
* AVD2 no longer pauses when not on Windows<br />
* Fixed AVD2 not working when not started from same folder as the executable<br />
* Added switch --UseCWD<br />
* Other changes I haven't remembered yet<br />
<br />
'''0.1.5028.0 : 2011.09.11'''<br />
* Fixed shift of hashvalues (_Display_ only)<br />
* Fixed --Ext with "to remove" extensions<br />
* Fixed --Mon/--TOut to actually work<br />
* Fixed some bug in the old CLI converter<br />
* <no ponies><br />
<br />
'''0.1.5000.0 : 2011.09.11'''<br />
* all previous builds aside of 4991 have been disabled<br />
* <more ponies><br />
<br />
'''0.1.4964.0 : 2011.09.05'''<br />
* all previous builds have been disabled<br />
* Sending ACReqs asynchronous<br />
* <insert ponies riding down the rainbow and other stuff that has happened><br />
<br />
'''0.1.4334.0 : 2011.06.15'''<br />
* all previous builds have been disabled<br />
* should work under linux via mono now too<br />
<br />
'''0.1.4260.0 : 2011.05.25'''<br />
* all previous builds have been disabled<br />
* fix for rare case where all xml submitted would contain an incorrect hash<br />
<br />
'''0.1.4213.0 : 2011.05.14'''<br />
* all previous builds have been disabled<br />
* addition of support and detection of new video file type: .mk3d<br />
* addition of support and detection of new audio file type: .dtshd, .thd<br />
* addition of support and detection of new subtitle file type: .pjs, .rt, .tmp, .tts, .xss, new type of .sub files<br />
* addition of support and detection of new linker file type: .smil <br />
* addition of support and detection of .zip files starting with magic bytes "PK00PK"<br />
<br />
<br />
'''0.1.3958.0 : 2011.03.15''' - no need to redump everything<br />
* fixed the bug that caused avdump2 not to retry sending a dump when facing a timeout<br />
* video-only mp4 files got wrongly detected as m4v<br />
* automatic detection of 32/64bit and use of the correct mediainfolib<br />
* test if mediainfolib is accessible<br />
* check of mediainfolib version to prevent the usage of untested versions<br />
* updated to mediainfolib 0.7.42<br />
* added -crcerr parameter to log files where the calculated crc is not found in the filename<br />
* added -x parameter to create a "parameterless avdump1"-like output<br />
* new switch -H to test pure hashing speed<br />
* removed Tiger and MD4 checksums from dumps sent to the AniDB server<br />
<br />
'''0.1.3084.0 : 2011.03.12'''<br />
* initial release<br />
</div><br />
<br />
[[Category:Features]]<br />
[[Category:AniDB Clients]]<br />
[[Category:Avdump]]<br />
[[Category:Development]]</div>JaLooNzhttps://wiki.anidb.net/index.php?title=Avdump&diff=11479Avdump2009-03-05T14:27:19Z<p>JaLooNz: Added batch file option</p>
<hr />
<div>{{TOCright}}<br />
<br />
==What is it==<br />
'''Avdump''' is a video codec identification utility - identifies which video codec and audio compression method is used on video files. Furthermore it calculates the used bitrates, the length, identifies the number of used audiochannel and more.<br><br />
It is mainly based on [http://mediainfo.sourceforge.net/en mediainfo], but got enhanced and changed to fit anidb's needs by [[User:Epoximator|epoximator]].<br><br />
'''Avdump''' was created with the intention to provide anidb with a tool to standarize the input for files and be a part of the upcoming [[AniDB O'Matic|AOM 0.6]]. It does however already support autocreqing by itself. See [[Avdump/Autocreqing]].<br />
<br />
===Supported formats===<br />
* avi, mkv, ogm, mp4, asf/wmv, mpg, rm, mov<br />
<br />
===Known issues===<br />
'''Note:''' Avdump is under development. Don't take the validity of its output for granted. Please report errors/issues.<br />
*Audio channel detection is very simple:<br />
**Number of channels might be wrong. (5.1 vs 6.1, 6.1 vs 7.1)<br />
**No check of actual data in channels. (dummy channels)<br />
*No detection of fps for asf/wmv files.<br />
*No detection of video anamorphism in mp4.<br />
*Only full parsing of avi, mkv and ogm container formats.<br />
*Avdump is only for Windows at the moment. It works via Wine though.<br />
*[[Avdump issues|More...]]<br />
<br />
==Download==<br />
Latest version (18th March 2008) is 0.34.<br />
Get your copy of avdump [http://static.anidb.net/client/avdump.rar HERE]!<br />
<br />
md5sum rar=225f2058812f601876fd5960bed95b74, exe=ee85a21848db15dc8bee3dd4180be953<br />
<br />
==Usage==<br />
'''Avdump''' is a simple [http://en.wikipedia.org/wiki/Command_line_interface command line] client:<br />
:<tt>avdump [-<options> ...] <media file/folder> [<media file/folder> ...]</tt><br />
<br />
===Options===<br />
{|align="center" style="border: 1px solid #aaaaaa; border-collapse: collapse; background: #f9f9f9; line-height: 1.0; font-size: smaller; width: 100%"<br />
! style="border: 1px solid #aaaaaa; font-size: 120%; background: #f2f2f2;" | Switch<br />
! style="border: 1px solid #aaaaaa; font-size: 120%; background: #f2f2f2;" | Info<br />
! style="border: 1px solid #aaaaaa; font-size: 120%; background: #f2f2f2;" | Example<br />
|-<br />
|'''ext''':<comma separated list>||Only process files with the specified extensions.||<tt>ext:mkv,avi</tt><br />
|-<br />
|'''log''':<file path/name>||Mirror the output to the specified file.||<tt>log:avdump.log</tt><br />
|-<br />
|'''exp''':<file path/name>||Export ed2k-links to the specified file. Very useful when mass adding files.||<tt>exp:ed2k-links.txt</tt><br />
|-<br />
|'''ac''':<username>:<api_password>||Enable automatic creqing. You should always use this option when dumping anime files!||<tt>-ac:tard:monkey</tt><br />
|-<br />
|'''port''':<port number>||Use the specified UDP port for communication with the AniDB server (api.anidb.net). Only needed when behind "strict" firewalls.||<tt>port:1337</tt><br />
|-<br />
|'''done''':<file path/name>||Save processed-file-paths to the specified file and exlude existing entries.||<tt>done:done.txt</tt><br />
|-<br />
|'''tout''':<timeout_in_seconds>:<number_of_retries>||Set timeout options.||<tt>tout:15:6</tt><br />
|-<br />
|'''bsize''':<KB_per_block>:<number_of_blocks>||Set size per block (2048 is default) and number of blocks in the circular buffer for hashing. If ''number of blocks'' is less than 2 then a plain single-threaded hasher is used. Might be useful if you got trouble with the default hasher.||<tt>bsize:512:16</tt><br />
|}<br />
<br />
<br />
{|align="center" style="border: 1px solid #aaaaaa; border-collapse: collapse; background: #f9f9f9; line-height: 1.0; font-size: smaller; width: 80%"<br />
! style="border: 1px solid #aaaaaa; font-size: 120%; background: #f2f2f2;" | Switch<br />
! style="border: 1px solid #aaaaaa; font-size: 120%; background: #f2f2f2;" | Type<br />
! style="border: 1px solid #aaaaaa; font-size: 120%; background: #f2f2f2;" | Description<br />
|-<br />
|s||Formatting||Use '''s'''hort/simple format.<br />
|-<br />
|l||Formatting||'''L'''ist codecs.<br />
|-<br />
|x||Formatting||Old '''X'''ML format (intended for AOM).<br />
|-<br />
|y||Formatting||New XML format (used when autocreqing).<br />
|-<br />
|c||Control||Do not re'''c'''urse into subfolders, only handle files in current folder.<br />
|-<br />
|i||Control||Sk'''i'''p full parsing (only for testing, not compatible with autocreqing).<br />
|-<br />
|m||Control||'''M'''onitor folder(s). Check for new files every now and then.<br />
|-<br />
|n||Control||Add an extra '''n'''ewline after each file file has been processed.<br />
|-<br />
|p||Control||'''P'''ause when done, keep command window open.<br />
|-<br />
|q||Control||Pause after each file.<br />
|-<br />
|r||Control||Randomize the file order.<br />
|-<br />
|t||Control||Print '''t'''ime used per file.<br />
|-<br />
|z||Control||Delete files after parsing.<br />
|-<br />
|o||Control||Wait for resp'''o'''nse when sending dumps and resend if needed.<br />
|-<br />
|0||Hash||crc32<br />
|-<br />
|1||Hash||ed2k<br />
|-<br />
|2||Hash||md5<br />
|-<br />
|3||Hash||sha1<br />
|-<br />
|5||Hash||tth<br />
|-<br />
|6||Hash||aich<br />
|-<br />
|9||Hash||Mode for hashing music files. Should be used together with <tt>-ac</tt>.<br />
|-<br />
|a||Hash||Include '''a'''ll hash algorithms.<br />
|-<br />
|h||Hash||'''H'''ash only mode, ie. no metadata parsing.<br />
|-<br />
|e||Hash||Print '''e'''d2k link<br />
|-<br />
|d||Hash||Print Ani'''D'''B link<br />
|-<br />
|g||Hash||Print AniDB link and open it with the default browser.<br />
|-<br />
|u||Hash||Print the time '''u'''sed for hashing per file.<br />
|}<br />
<br />
===Windows Shortcut===<br />
#Extract avdump to a folder of choice.<br />
#:Example: "C:\Program Files\avdump\"<br />
#Right-click avdump.exe, select ''Create Shortcut''.<br />
#Right-click the shortcut, add options to the ''Shortcut - Target'' line.<br />
#:Example, normal usage: <tt>"C:\Program Files\avdump\avdump.exe" -p</tt><br />
#:Example, autocreq usage: <tt>"C:\Program Files\avdump\avdump.exe" -o -ac:''myName'':''myApiPass''</tt><br />
#::You can also set other options like ''s'', ''x'' or ''t'' if you wish to do so.<br />
#::A commandline option to export ED2K links to a file is by adding -exp:''C:\Path\filename.txt'', etc.<br />
#::Note that you need to set an API password in your anidb profile for autocreqing.<br />
#:Optional: Change ''Run'' to ''Maximized''.<br />
#Drag and drop any media-file onto the shortcut.<br />
====Send to====<br />
#Move shortcut to the SendTo folder.<br />
#:Example, under XP: "C:\Documents and Settings\''Username''\SendTo"<br />
#:Example, under Vista: "C:\Users\''Username''\AppData\Roaming\Microsoft\Windows\SendTo"<br />
#::Where ''Username'' is your Windows Login-Name.<br />
#:Note that ''SendTo'' is a hidden folder.<br />
#Right-click any media-file, goto "Send To", choose avdump.exe<br />
#Get [[Creq|CReqing]]<br />
<br />
===MS-DOS Batch File===<br />
#Extract avdump to a folder of choice.<br />
#Create a MS-DOS batch file with the 2 lines below, and save it as ''filename.bat''.<br />
#:@ECHO OFF<br />
#:C:\AVDumpPath\avdump.exe %1 -exp:''C:\Path\filename.txt'' -ac:''myName'':''myApiPass''<br />
#Drag and drop any media-file onto the shortcut.<br />
<br />
===Graphical user interface===<br />
''See:'' '''[[Avdump GUI]]'''<br />
<br />
===Processing DVD's===<br />
For processing DVD's it's best to set a small blocksize. Helps to improve performance.<br />
<br />
something like<br />
<pre><br />
-bsize:256:1<br />
</pre><br />
<i>(default is 2048)</i><br />
<br />
== Autocreqing ==<br />
[[Image:Autocreq.gif|thumb|Simple diagram of the way autocreqing with avdump works]]<br />
<br />
Avdump is now part of a new [[autocreqing]] system. Some more or less important notes:<br />
* To be able to use this feature you’ll need an AniDB account and you have to define the ''api key'' in your [[profile]]. All data sent to the server will be logged with ip and uid.<br />
* Communication between client and server is ''one-way'' (except session init/refresh); the client does not receive any confirmation for sent data. This means that there is no guaranty that all the dumps you send will arrive at the server and stored in the database, and there is no way to check this. ''From version 0.31 it's possible to make avdump wait for confirmation from the server by using the -o switch.''<br />
* It is possible to run more than one instance of avdump at once, but not more than ten will work ok. At the moment ''only 10 sessions per ip are allowed by the server'', meaning the eleventh instance will terminate the first.<br />
* There is no direct connection between data sent to AniDB and creqs generated. The data received will just be stored for later processing. There is no way to check the current status for a dump. Usually, it should take ''at least 24 hours'' from the moment you dump a file till the data actually changes. If any irregularities occur, or when there is too much data pending, it will take more time.<br />
* The creqs generated will report the user who sent the data first (for a specific file) as the creqer.<br />
* You may dump files currently not in the db. The data is still stored and will be used later if/after the file has been registered.<br />
* Files creqed by the new system will be locked, meaning some fields will not be possible to change. Notify a moderator if you are '''sure''' that some of the data locked for a specific file is wrong.<br />
* Not all dumps are sent to the server; Only mkv, ogm, avi, mp4, mov, rm and mpeg dumps from non corrupted files are sent:<br />
** The asf parser does not detect fps.<br />
** Audio files are too few and not considered important atm.<br />
** Nothing useful can be extracted from archives and subtitles (that I can think of).<br />
<br />
===Why didn't this file get dumped?===<br />
* It's not avi/mkv/ogm/mp4/mov/mpg/rm.<br />
* The file in AniDB is registered with wrong size and/or ED2K hash.<br />
* The package never reached the server.<br />
* The decryption or decompression failed at server side (rare).<br />
* The dump is not valid XML (rare).<br />
<br />
===Why isn't this file verified?===<br />
Even if the file is dumped it doesn't mean it will get autocreqed (and verified). Here are the reasons:<br />
* The file is corrupt/invalid ([http://anidb.info/perl-bin/animedb.pl?show=avmf&do=xml&avid=76226 example]).<br />
* The provided data is considered "incoherent". (Indicates a bug in avdump.)<br />
* The dump was marked unfit for file verification by an AniDB Moderator.<br />
* The file type is not included in autocreqing yet (mov/mpg/rm atm).<br />
<br />
===What's the current status?===<br />
Look [[Avdump status|here]].<br />
<br />
==Development==<br />
The source can be found [http://dev.anidb.net/websvn/listing.php?repname=AniDB+CSS&path=%2Ftrunk%2Fudp_clients%2Favdump%2F&rev=0&sc=0 here]. Avdump has only been built on MS Windows systems.<br />
<br />
===Required libraries===<br />
* zlib 1.2.3 - http://www.zlib.net/ (used by several other libs)<br />
* libebml 0.7.7 - http://dl.matroska.org/downloads/libebml/ (used by MatroskaUtils)<br />
* libmatroska 0.8.1 - http://dl.matroska.org/downloads/libmatroska/ (used by MatroskaUtils)<br />
* libogg 1.1.3 - http://www.xiph.org/downloads/ (used by ogmtools)<br />
* libvorbis 1.1.2 - http://www.xiph.org/downloads/ (used by ogmtools)<br />
* ZenLib CVS (09.09.2007) - http://sourceforge.net/projects/zenlib/ (used by MediaInfoLib)<br />
* MediaInfoLib CVS (09.09.2007) - http://sourceforge.net/projects/mediainfo/ (avi, mp4, etc. parsing)<br />
* ogmtools SVN (13.08.2005) - http://svn.corecodec.org/ogmtools (ogm parsing)<br />
* MatroskaUtils SVN (26.07.2005) - http://svn.matroska.org/viewsvn/trunk/MatroskaUtils/ (mkv parsing)<br />
* libFooID 1.0 - http://foosic.org/libfooid.php (fooid fingerprint)<br />
* mpg123-0.65 - http://www.mpg123.de/ (mp3 decoding)<br />
* tinyxml 1.0.1 - http://www.grinninglizard.com/tinyxml/ (xml generation)<br />
* wxWidgets-2.8.7 - http://www.wxwidgets.org/ (used by MediaInfoLib and avdump.exe)<br />
<br />
==Changelog==<br />
<div style="height: 280px; overflow: auto; padding: 3px; border:1px solid #AAAAAA; font-size: smaller"><br />
<br />
0.34.00 : 080316 - no need to redump your collection<br />
*New switch 'N'; No data output. Does not affect error messages or progress.<br />
*Print average hashing speed on -u.<br />
*Fixed minor issue with avg and std fps for mkv files with first timecode != 0.<br />
*Executable self-check to prevent bad versions/hw from submitting data.<br />
<br />
0.33.00 : 080106 - importance: medium<br />
*Fix: support for SimpleBlock @ mkv (affects only a few files atm).<br />
*Fix: -done was broken.<br />
*Fix: fps was rounded in -s and default output.<br />
*New switch '-host:<host name>', default is 'api.anidb.net'.<br />
<br />
0.32.01 : 071212 - importance: low<br />
*New switch 'v': use \n instead of \r @ progress.<br />
*New switch 'w': supress progress completely.<br />
*New switch 'ms:<ms>': monitor sleep duration in micro seconds.<br />
*Fix: don't export ed2k link on error.<br />
*Fix: only enumerate writable files.<br />
<br />
0.32.00 : 071016 - importance: high<br />
*OstFile proto.<br />
*Fixed 1000000 fps for some mkv files.<br />
*Fixed bitrate for some avi files.<br />
*Fixed hashing for large files.<br />
*Fixed parsing of large mkv files.<br />
*Fixed .sub files identified as mpg.<br />
*Faster hashing.<br />
*Both ed2k hashing algorithms.<br />
*Latest MediaInfoLib.<br />
<br />
0.31 : 070225 - importance: low<br />
*Fixed batch abort when parser fails to recognize a file.<br />
*Fixed <lib> for some mpg files (95446).<br />
*Fixed <lib> for one avi file (199976).<br />
*Added mp3-ignore-metadata hash (test).<br />
*Updated avmf dump protocol.<br />
0.30 : 070123 - importance: high<br />
*Added option '-done:' for keeping track of already processed files.<br />
*Added speed calculation for hashing.<br />
*Added timeout (30 sec) and retry (6 times) for session refresh (-tout).<br />
*Added option for hashing buffer size.<br />
*Added monitor (-m) option. Re-check folder(s) every minute.<br />
*Added delete (-z) option.<br />
*Added timestamp to -t switch.<br />
*Added option to not recurse into subfolders (-c).<br />
*Fixed crash on 222427, 29542, 14303.<br />
*Fixed 'stream not found' for some avi files.<br />
*Fixed tth crash for 0 byte files.<br />
*Fixed skipping of files with names starting with dot.<br />
0.29 : 070113 - importance: high<br />
*Autocreq<br />
*Ed2k export to file (-exp:<file>).<br />
*Various forgotten fixes and changes.<br />
0.28 : 061123 - importance: test version<br />
*Fixed broken duration for vorbis in ogm (was 0).<br />
*Fixed broken language detection.<br />
*Fixed/removed default track flag in ogm.<br />
*Changes in the switches: y = XML2+autocreq, c = autocreq.<br />
*Added SBR detection for AAC in mp4.<br />
*Added x264 settings string to XML2 for mkv.<br />
*New mediainfo.<br />
0.27 : 060927 - importance: low<br />
*WARNING:<br />
:* This is an experimental version for a new autocreq system.<br />
:* Due major internal changes it's likely to be borked.<br />
:* Only upgrade if you want to help testing; use -c.<br />
:* No actual creq will be filed, but data are gathered.<br />
*Improved/fixed ogm and avi track size calculation.<br />
:*Error was less than ~30 KB for a normal file.<br />
*Fixed samplerate=0 when audio not vorbis and added PCM recognition in ogm parser.<br />
*Fixed wrong AR printed when > 1.70.<br />
*Fixed missing zeros at beginning in crc32 checksums.<br />
0.26 : 060912 - importance: low<br />
*Changes in the xml mode; formatted time and exact channels value.<br />
*Added option to skip parsing altogether (hash only mode).<br />
*Added switch '-ext:{comma separated file extension list}'.<br />
*Changes in the arguments. See usage.<br />
0.25 : 060907<br />
*Added md5 hash.<br />
*Added ed2k link output.<br />
*Changes in the arguments. See usage.<br />
*Fixed extension check (case).<br />
0.24 : 060902<br />
*Added 5.1 audio bitrate test; if under 100 kbps then print warning.<br />
*Added Matroska attachment support; used when checking overhead.<br />
*Added hashing; crc, ed2k, sha1, tth and aich.<br />
0.23 : 060817<br />
*Changed: log file is now utf8.<br />
*Fixed video vs audio duration issue with non mkv/ogm files. (fid: 252353)<br />
0.22 : 060806<br />
*Fixed unicode-in-file-name issue.<br />
*Added VFR test for mp4 files.<br />
*Added switch 'c': pause after each file.<br />
*Changes in AR rages and removed 'Wrong AR'.<br />
*Minor fixes and changes.<br />
0.21 : 060726<br />
*Fixed codec detection in private frame (user data).<br />
*Added switches 'a' (avi), 'm' (mkv), 'o' (ogm), and 'f' (mp4): Only parse these types.<br />
*Added switch 'l': list mode ({file path/name}\t{track #1 codec}\t...\t{track #n codec}).<br />
*Added switch 'i': skip full parsing (mkv/ogm/avi). Only for testing. Do _not_ use when creqing.<br />
0.20 : 060717<br />
*Added return code in xml mode and more warnings in the other modes.<br />
*Fixed mp4 parser; audio track sizes.<br />
*Fixed mkv crash on corrupt files (fid: 216911).<br />
*Fixed wrong track duration on mkv files where the first timecode is not 0 (fid: 234960).<br />
0.19 : 060711<br />
*Fixed rm parser.<br />
*Fixed mpeg parser, video bitrate.<br />
*Minor stuff.<br />
*Short format does _now_ print video duration.<br />
*Improved the mp3 vbr test. (fid: 240676)<br />
0.18 : 060624<br />
*MP4 fixes: sub tracks, track lang, missing chan/srate.<br />
*Updated MediaInfoLib (latest cvs).<br />
*Minor changes in normal output format (duration and size).<br />
*Short format does now print video duration (ie. not header value).<br />
0.17 : 060602<br />
*Added extension check.<br />
*Changes xml output.<br />
*Fixed memory leak when parsing mp4.<br />
0.16 : 060529<br />
*Fixed some RIFF bugs.<br />
*Fixed randomizor bug.<br />
*Updated anidb codec identifiers.<br />
*Added jni.<br />
*Changes in xml and short mode.<br />
0.15 : 060518<br />
*Updated libebml, libogg, libvorbis.<br />
*Added switch 'r': random file order.<br />
*Added switch 'n': extra newline per file.<br />
*Changes in 'short' output mode.<br />
*Track numbering starts on 1 now.<br />
*Changes in ar detection, see: http://wiki.anidb.info/w/Avdump/AR<br />
*Fixed: Track sizes might be slightly wrong for OpenDML files.<br />
*Packed exe and dll (UPX 2.00w).<br />
0.14 : 060514<br />
*Added anidb AR, flags and chan str to normal output.<br />
*Added new output mode: short (-s).<br />
*Added switch -t: show proc time (per file).<br />
*Fixed high mem usage bug on some file formats.<br />
*Fixed access violation on files with very many tracks.<br />
*Added track names (mkv only).<br />
*Added version in output.<br />
*Some tweaking of output format.<br />
0.13 : 060511<br />
*Fixed wrong track durations for some mkv files.<br />
*Added anidb channel id (only in xml).<br />
0.12 : 060510<br />
*Improved VFR check.<br />
*Added anidb video flags (only in xml).<br />
0.11 : 060509<br />
*Added anidb codec id for ogm (and fixed a minor issue for some mkv files).<br />
*Added simple VFR check for mkv files.<br />
0.10 : 060501<br />
*Added MP3 VBR check on avi and mkv files (variable frame size check).<br />
*Added xml output (-x).<br />
*Added anidb codec id, and some checking on fourcc vs user data.<br />
*Added anidb lang and ar id (only printed in xml mode).<br />
*Fixed some issues with mp4, rm and mpg files.<br />
0.09 : 060401<br />
*Fixed track size for all non mkv/ogm/avi/mp4.<br />
*Changes in the output format.<br />
0.08 : 060330<br />
*Exe is now unicode.<br />
*Fixed wrong output for avi files with multiple audio tracks.<br />
*Added better track size calc for avi files. (first try)<br />
*Added track duration.<br />
0.07 : 060314<br />
*Fixed broken ogm parsing (language).<br />
0.06 : 060305<br />
*Fixed wrong duration for some mkv files.<br />
*Fixed wrong track size for some mkv files.<br />
0.05 : 060221<br />
*Improved USER data check.<br />
*Killed some memory leaks.<br />
0.04 : 060217<br />
*Fixed 'AAC in OGM' crash.<br />
*Added check for USER data in mkvs and ogms.<br />
*Cleaned codec output for mkvs.<br />
*Added some filecomment output.<br />
</div><br />
<br />
[[Category:Features]]<br />
[[Category:Anidb Clients]]<br />
[[Category:Avdump]]<br />
[[Category:Development]]</div>JaLooNz