pyTivo Discussion Forum Forum Index pyTivo Discussion Forum
Answers and the development of pyTivo a TiVo transcoding server
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Metadata files

 
Post new topic   Reply to topic    pyTivo Discussion Forum Forum Index -> pyTivo
 View previous topic :: View next topic  
Author Message
MasterCephus



Joined: 04 Jan 2008
Posts: 156
Location: Hueytown, AL

PostPosted: Fri Aug 15, 2008 5:23 am    Post subject: Metadata files Reply with quote

So I was sitting here wondering why we don't use xml files instead of flat text files? I assume that pyTivo just reads the files and pushes the data to the Tivo along with the video file...so why not use xml?
_________________
MetaGenerator
pyTivo Manager
Back to top
View user's profile Send private message
stealthdave



Joined: 23 May 2008
Posts: 16
Location: Santa Monica, CA

PostPosted: Fri Aug 15, 2008 9:44 am    Post subject: Reply with quote

Someone can correct me if I'm wrong, but it looks like the current format is the same one used by the TiVo Desktop software

http://www.tivocommunity.com/tivo-vb/showthread.php?p=5722528#post5722528

There is an xml format for this data out there using the "hacked" tivo formats (.tmf and .ty+; search the Deal Database forums for more details). If you have a hacked TiVo and install mfs_ftp, you can actually extract just the metadata xml file for a given program. Keeping the existing format probably makes a certain amount of sense because it allows you to use metadata provided by TiVo Desktop. XML would be nice because it's a fairly standard format and could also allow for some backwards compatibility with old Series 1 and Series 2 w/o HMO (i.e., DirecTV).

One possibility would be to support both formats, using the file extension (.xml or .txt) to determine how to process it. If both are present, use .txt as default.

All it takes is a developer with time on his hands. Smile

- Dave
Back to top
View user's profile Send private message Visit poster's website
MasterCephus



Joined: 04 Jan 2008
Posts: 156
Location: Hueytown, AL

PostPosted: Fri Aug 15, 2008 10:49 am    Post subject: Reply with quote

Well I was just thinking that it would make the metagenerator's life a lot easier if it were in an XML format...

And I have another metadata manager idea that I was tossing in my head that I would like to do so it would be a good time to switch if we did it...

_________________
MetaGenerator
pyTivo Manager
Back to top
View user's profile Send private message
wmcbrine



Joined: 04 Jan 2008
Posts: 444

PostPosted: Fri Aug 15, 2008 11:02 am    Post subject: Reply with quote

stealthdave wrote:
Someone can correct me if I'm wrong, but it looks like the current format is the same one used by the TiVo Desktop software

http://www.tivocommunity.com/tivo-vb/showthread.php?p=5722528#post5722528

Eh? I'm not aware of any ability to use metadata with TiVo Desktop (unless you count the data inside .tivo files). That message is about tags that will work in pyTivo.

When I first added metadata to pyTivo, it was description-only, as a text file. As we discovered more useful tags, I suggested just passing through the XML, which is how it ends up anyway. But armooo had a different idea.

One reason might be that the XML served to the TiVo actually comes in two parts, with different sets of tags, both of which pyTivo generates from the same metadata file. Also, I suppose it saves typing (if you're making the metadata files by hand); and some validation is necessary anyway, since not all combinations of tags are valid. Anyway, what's done is done, and at this point, adding the ability to switch between text and XML would only add more code to pyTivo, for little benefit that I can see.

_________________
My pyTivo fork


Last edited by wmcbrine on Fri Aug 15, 2008 11:44 am; edited 1 time in total
Back to top
View user's profile Send private message
danimal4326



Joined: 14 Apr 2008
Posts: 20

PostPosted: Fri Aug 15, 2008 11:33 am    Post subject: Reply with quote

you can also extract XML from .tivo files as well that you transfer over with TivoDesktop or the pytivo web admin thingy..


the program "tdcat" comes with the tivodecode source..
Back to top
View user's profile Send private message
wmcbrine



Joined: 04 Jan 2008
Posts: 444

PostPosted: Fri Aug 15, 2008 11:43 am    Post subject: Reply with quote

One thing that would be useful: a way to convert XML from the TiVo to pyTivo metadata files. I was going to add this to the TiVoToGo function in the admin module, but it could work as a standalone program, too.
_________________
My pyTivo fork
Back to top
View user's profile Send private message
danimal4326



Joined: 14 Apr 2008
Posts: 20

PostPosted: Fri Aug 15, 2008 1:23 pm    Post subject: Reply with quote

Hmm seems to be somewhat of a difference in the XML from .tivo files and the XML from files i transfer from pytivo to my TiVo, then back again to my pc.


Family Guy - pytivo - chunk 1.xml.txt
 Description:
XML from pyTivo transferred file - chunk 1

Download
 Filename:  Family Guy - pytivo - chunk 1.xml.txt
 Filesize:  4.83 KB
 Downloaded:  13 Time(s)


Family Guy - .tivo - chunk 2.xml.txt
 Description:
XML from .tivo file - chunk 2

Download
 Filename:  Family Guy - .tivo - chunk 2.xml.txt
 Filesize:  5.75 KB
 Downloaded:  13 Time(s)


Family Guy - .tivo - chunk 1.xml.txt
 Description:
XML from .tivo file - chunk 1

Download
 Filename:  Family Guy - .tivo - chunk 1.xml.txt
 Filesize:  5.04 KB
 Downloaded:  14 Time(s)

Back to top
View user's profile Send private message
danimal4326



Joined: 14 Apr 2008
Posts: 20

PostPosted: Fri Aug 15, 2008 1:24 pm    Post subject: Reply with quote

another file


Family Guy - pytivo - chunk 2.xml.txt
 Description:
XML from pyTivo transferred file - chunk 2

Download
 Filename:  Family Guy - pytivo - chunk 2.xml.txt
 Filesize:  5.55 KB
 Downloaded:  12 Time(s)

Back to top
View user's profile Send private message
stealthdave



Joined: 23 May 2008
Posts: 16
Location: Santa Monica, CA

PostPosted: Sun Aug 17, 2008 6:42 pm    Post subject: Reply with quote

wmcbrine wrote:
stealthdave wrote:
Someone can correct me if I'm wrong, but it looks like the current format is the same one used by the TiVo Desktop software

http://www.tivocommunity.com/tivo-vb/showthread.php?p=5722528#post5722528

Eh? I'm not aware of any ability to use metadata with TiVo Desktop (unless you count the data inside .tivo files). That message is about tags that will work in pyTivo.

On Mac OS X, TiVo Desktop will generate a properties file with the same name as the mpg, but with .properties as the extension. I guess I made the assumption that these were compatible. I don't know which parameters are accepted, but here's a sample file that's autogenerated when you drop a compatible file into the folder:
Code:
#Sun Aug 17 19:37:16 PDT 2008
description=
title=Terminator- The Sarah Connor Chronicles - The Turk.mpg

If you edit this file, whatever you enter shows up on the TiVo.

- Dave
Back to top
View user's profile Send private message Visit poster's website
philhu



Joined: 04 Jan 2008
Posts: 121

PostPosted: Mon Aug 18, 2008 7:49 am    Post subject: Re: Metadata files Reply with quote

MasterCephus wrote:
So I was sitting here wondering why we don't use xml files instead of flat text files? I assume that pyTivo just reads the files and pushes the data to the Tivo along with the video file...so why not use xml?


The flat text files is from Tivo. It is used internally to create their listing 'slices' of data, and a few user programs took it on to build their listings. The keyword fields are 98% the same as Tivo uses and the field formats, with one exception or two, are the same too.

Do a google on 'ParseXMLGuide'. This is/was the program that let a user create Tivo 'slices' to load up a program guide using Zap2It xml listings. All long gone. (I am the author of this 'work).
Back to top
View user's profile Send private message
wmcbrine



Joined: 04 Jan 2008
Posts: 444

PostPosted: Mon Aug 18, 2008 7:52 am    Post subject: Reply with quote

stealthdave wrote:
On Mac OS X, TiVo Desktop will generate a properties file with the same name as the mpg, but with .properties as the extension.

Interesting! That's the first I've heard of it, but I admit, I've never been a big TiVo Desktop user. I wonder if there's any analog in the Windows version?

It appears they wouldn't quite be compatible, since that's using '=' as the separator, and pyTivo uses ':'.

_________________
My pyTivo fork
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    pyTivo Discussion Forum Forum Index -> pyTivo All times are GMT - 8 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum
Site is in NO WAY affiliated with TiVo Inc

Powered by phpBB © 2001, 2005 phpBB Group
phpBB SEO
[ Time: 0.2214s ][ Queries: 15 (0.0878s) ][ Debug on ]