Welcome to the Invelos forums. Please read the forum rules before posting.

Read access to our public forums is open to everyone. To post messages, a free registration is required.

If you have an Invelos account, sign in to post.

Invelos Forums->Posts by mediadogg Page: 1... 17 18 19 20  Previous   Next
Message Details
Quoting AiAustria:
Quote:
Timing of CLT Plus here in Europe:

John Wayne: about 14mins 11secs
Tom Cuise: about 18mins 47secs
Zhang Ziyi: about 1min 33secs

Environment:
Asynchronous cable internet 150/15Mbit, not heavily loaded, but I watched your video in parallel ;-)
RTT to the farest responding hop on the way to www.invelos.com:
17  144 ms  139 ms  150 ms  c-73-152-128-139.hsd1.va.comcast.net [73.152.128.139]

Oh, thanks very much for this.
Posted:
Topic Replies: 410, Topic Views: 20667
Yes, it is well established that Goodguy used only scraping. In fact, the plugin API didn't allow online access back when he did that code (at least, I didn't think so. What does his downloaded XML consist of?).  And of course I know that the data is available by clicking on the profile links. (Edited)

Two issues: First, I thought people wanted other data. If this is not the case, then what am I doing? Second, so far nobody has been able to duplicate Goodguy's clever scraping methods. I know that I can't, but now that I can access the database, why scrape if you are in a plugin? Now if somebody wants to attempt to scrape the credits, I would be happy to donate my scraping of the profile ID list to the cause. Then, "all" you would need to do is write a program to click on the links, wait for the info to download to browser, and then scrape it. Goodguy was able to do it amazingly fast. I don't have the time or willpower to even try to duplicate that, and furthermore, those methods no longer work in today's browsers (if I am wrong on that, I would LOVE to know about it!!!)

I was not aware of the problem with CLT session handling. I will explore it. When running in a plugin, there would be multiple browser instances, not multiple tabs. Maybe that will allow it to work.
Posted:
Topic Replies: 410, Topic Views: 20667
I have made a video first look at a plugin I call "CLTBoss".

Actually it is a menu option off BulkEdit, as a convenience to me, because supporting a separate plugin takes more time than I can give at the moment.

Any ideas for enhancements or changes are welcome. After publication, I will be more reluctant to consider changes other than bug or performance fixes.

First Looks at CLTBoss.
Posted:
Topic Replies: 410, Topic Views: 20667
Well my Clint Eastwood took about an hour on my machine. 18 minutes for the initial scraping to get the list of profiles, and the rest for scanning the XML for credits. I found over 6,000 due to the fact that Eastwood often "does it all".

Here is an example:
Quote:

  <CLTCredits>
    <CLTCredit type ="cast" Episode="" GroupName="" FirstName="Clint" MiddleName="" LastName="Eastwood" BirthYear="0" CreditType="cast" CreditedAs="" Role="Luther Whitney" Voice="False" Uncredited="False" Puppeteer="False"/>
    <CLTCredit type ="crew" Episode="" GroupName="" FirstName="Clint" MiddleName="" LastName="Eastwood" BirthYear="0" CreditType="crew" CreditedAs="" Role="Director" Voice="False" Uncredited="False" Puppeteer="False"/>
    <CLTCredit type ="crew" Episode="" GroupName="" FirstName="Clint" MiddleName="" LastName="Eastwood" BirthYear="0" CreditType="crew" CreditedAs="" Role="Producer" Voice="False" Uncredited="False" Puppeteer="False"/>
    <CLTCredit type ="crew" Episode="" GroupName="" FirstName="Clint" MiddleName="" LastName="Eastwood" BirthYear="0" CreditType="crew" CreditedAs="" Role="Composer" Voice="False" Uncredited="False" Puppeteer="False"/>
  </CLTCredits>


By the way "type" and "CreditType" are duplicate attributes. I will be removing "type".

I will experiment with speeding things up and also running at least two name variants in parallel.
Posted:
Topic Replies: 410, Topic Views: 20667
Can someone give me some sample timings for CLTPlus results? How long does it take before you can export the data for John Wayne, or Tom Cruise, or any other example. I want to compare with what I am getting with my code.

Oh, I see some earlier. 15 min for Clint Eastwood. So that's my bar. I'm not that fast yet, but I am displaying a progress and other stuff.  UI output really slows things down, so I will give it a try with minimal display output.
Posted:
Topic Replies: 410, Topic Views: 20667
Well I thought I nailed it! 

Obviously didn't. If anybody cares to tell me what I missed from the requirements, I would be interested.
Posted:
Topic Replies: 16, Topic Views: 9669
Quoting AiAustria:
Quote:
...
I don't know, if it is usefull to seperate the name into F/M/L, because the CLT does the oposite. It equals First Middle//Last with First/Middle/Last...

Eventually though, somebody has to decide, because the underlying database has three fields plus BY. Now that I have recoded to let the user decide, I might leave it that way and shoot my video and see how you like it.

I think I am basically doing what Goodguy did: first run the CLT tool (you can't beat Ken's speed because his is native, and scrape the web pages for profile IDs. Then Loop on the profile IDs, grabbing the credits from the online database. And just as you say he does, this is where I filter for BY.) The web browser I use is built into the plugin, and I am sure that is IE based. But it runs wherever DVD Profiler and the plugin runs. You can use whatever browser you want for your other work.
Posted:
Topic Replies: 410, Topic Views: 20667
Quoting Moses277:
Quote:
Just to let you all know that if you update to the latest version of windows 10 you will need to switch the s-mode off as profiler will not run in s-mode

No clue what you are talking about.

Ok, I found this Microsoft FAQ on s-mode.  (Thanks Moses277 for the heads up).
Posted:
Topic Replies: 13, Topic Views: 7164
If a complex search is needed, my code is already structured to loop on name variants once inside the bowels of a profile. So, I would accept a proposal for (or explanation of an existing one) method for specifying the syntax, and I would appreciate a tested Regex expression that parses the text into matches so I can just index into sets of FN,MN,LN,BY to use as variants.
Posted:
Topic Replies: 410, Topic Views: 20667
Quoting AiAustria:
Quote:
From my side there definitly is interest on this topic: getting rid of IE and all its legacy stuff should be a goal for everyonye...

Ok, so now is the best time if you have suggestions from what you see here. I will try to do a little video before I go much further, and get more suggestions before "finishing". Oh, if you have come across a particularly interesting one - complexity and/or processing time, give it to me, and we can compare.

Oh, and:

(1) Is there a standard way of entering a CLT search in a single text box, or is FN , MN, LN, BY in separate boxes OK?
(2) Is there a way to specify variants in a single search, or are the searches usually separate? (e.g. zhang zhi, zhi zhang, zhang ziyi) ?
Posted:
Topic Replies: 410, Topic Views: 20667
Quoting mediadogg:
Quote:
Ok, here is my compromise:

I tried to make as much as possible identical to Profiler XML, except the credits info is formatted to make it super easy to parse for you and not force you to redo the work of parsing dividers and episode markers. Any other DVD Info that you want / need, of course I can add that easily to the export.

Quote:

<?xml version="1.0" encoding="windows-1252"?>
<!-- Credit Information Export (c) 2019 mediadogg Software -->
<CLTInfo>
<DVD>
  <ID>5051889528654.8</ID>
  <ID_Base>5051889528654</ID_Base>
  <ID_LocalityID>8</ID_LocalityID>
  <ID_LocalityDesc>France</ID_LocalityDesc>
  <Title>Black Storm</Title>
  <OriginalTitle>Into the Storm</OriginalTitle>
  <ProductionYear>2014</ProductionYear>
  <CLTCredits>
    <CLTCredit type ="crew" Episode="" GroupName="Visual Effects by [Hy*Drau&quot;Lx]" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" CreditType="crew" CreditedAs="" Role="Visual Effects" Voice="False" Uncredited="False" Puppeteer="False"/>
  </CLTCredits>
</DVD>
<DVD>
  <ID>723952078414</ID>
  <ID_Base>723952078414</ID_Base>
  <ID_LocalityID>0</ID_LocalityID>
  <ID_LocalityDesc>United States</ID_LocalityDesc>
  <Title>Rock Slyde Private Eye</Title>
  <OriginalTitle></OriginalTitle>
  <ProductionYear>2009</ProductionYear>
  <CLTCredits>
    <CLTCredit type ="cast" Episode="" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" CreditType="cast" CreditedAs="" Role="Steve Bookerson" Voice="False" Uncredited="False" Puppeteer="False"/>
    <CLTCredit type ="crew" Episode="" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="0" CreditType="crew" CreditedAs="" Role="Producer" Voice="False" Uncredited="False" Puppeteer="False"/>
  </CLTCredits>
</DVD>
<DVD>
  <ID>8712626073345.30</ID>
  <ID_Base>8712626073345</ID_Base>
  <ID_LocalityID>30</ID_LocalityID>
  <ID_LocalityDesc>Belgium</ID_LocalityDesc>
  <Title>Ash vs Evil Dead: Seizoen 3</Title>
  <OriginalTitle></OriginalTitle>
  <ProductionYear>2018</ProductionYear>
  <CLTCredits>
    <CLTCredit type ="cast" Episode="4. Unfinished Business" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="1971" CreditType="cast" CreditedAs="" Role="Gary" Voice="False" Uncredited="False" Puppeteer="False"/>
    <CLTCredit type ="cast" Episode="6. Tales from the Rift" GroupName="" FirstName="Will" MiddleName="" LastName="Wallace" BirthYear="1971" CreditType="cast" CreditedAs="" Role="Gary" Voice="False" Uncredited="False" Puppeteer="False"/>
  </CLTCredits>
</DVD>
</CLTInfo>


Any interest still remain on this? I got past a major hurdle today. I might still need an AutoIt bandaid, but all the underlying code seems to be working now. This would be the time to let me know of any tweaks. I will likely only arrange to produce the fastest XML export as I can (it will still be a grind for popular people), and other apps can format in useful ways.

A reminder: this process pulls profile info directly from the online database, and does not depend on what is in your local collection. So if you want anything else to appear in the exported results, I should be able to output it, keeping performance and reasonableness in mind.  (should there be an option to override the online with the local credits?)
Posted:
Topic Replies: 410, Topic Views: 20667
^^^^^
Yes, what he said!!!
Posted:
Topic Replies: 48, Topic Views: 12733
Yup, I see your points. We are all frustrated with not knowing. And afraid maybe it was something urgent or tragic ... 
Posted:
Topic Replies: 48, Topic Views: 12733
Quoting AiAustria:
Quote:
... and I'm still hoping for community driven continuation after a closure...

I wish I knew how to reach the owners to see if they would release some technical info about how to run the online part.
Posted:
Topic Replies: 48, Topic Views: 12733
Quoting elangab:
Quote:
Quoting iPatsa:

Quote:


My point was only that whatever you buy, at some point it will become obsolete and unsupported. Same thing with DVD Profiler. But considering the service I've been getting all these years I don't have an issue with that, sad as it may be. I think I've already got my money's worth, and then some.


I think that most people are OK with the software getting obsolete, but would welcome some official announcement for it. It's the limbo that's weird, not the fact that they've decided to stop developing it.

What would you do differently if you had an official announcement? Be careful what you wish for. Where would you go to complain if you got the announcement "we are closing. Goodbye."? Let it be.

And I agree with iPatsa - I've got my $29 worth so many times over. Wish all my software purchases had been so valuable.
Posted:
Topic Replies: 48, Topic Views: 12733
Post not needed. Not sure why the thread got marked as updated on my system ....
Posted:
Topic Replies: 16, Topic Views: 6518
Here is the tutorial video for making WatchList boxsets.
Posted:
Topic Replies: 16, Topic Views: 9669
Here is an updated view of WatchLists.

Ok, this uses the same basic idea proposed by Gunnar earlier, but to solve the problem of breaking up real box sets to make the fake ones, I used "Custom Profiles" (make them using BulkEdit).

Tomorrow or soon thereafter, I will post a tutorial video.
Posted:
Topic Replies: 16, Topic Views: 9669
Got a PM today from OP saying that what I showed really was not a solution for him, and actually was very similar to other proposals he rejected. So, that's it. Took my shot and missed. Can't win them all! 

Have to admit, it is kind of an interesting idea. I might use my imperfect version someday.
Posted:
Topic Replies: 16, Topic Views: 9669
I got information from the user that the original import sort of worked, however I was not able to get more detailed information so that I could make improvements. A shame, since the new code for importing Version 2 of CZ might be able to be retrofitted into the code for importing Version 1. Out of respect for privacy, I could never require that a user send me the entire exported database, but a partial export containing some examples of profiles that failed to be recognized, would have been very helpful.
Posted:
Topic Replies: 4, Topic Views: 3318
Anybody who might be interested in this topic, here is as far as I got, without writing a new plugin.

Both the process and result have some quirks, but you can do what the picture shows today, using features of the main program and some BulkEdit functions. A new plugin could make the process simpler, but I do not have time to write it. I am posting this in case somebody else has ideas or interest in moving the project further.
Posted:
Topic Replies: 16, Topic Views: 9669
Any news?
Posted:
Topic Replies: 7, Topic Views: 4700
Quoting jjom:
Quote:
How can I choose for example 20 DVDs and put them on loan, avoiding making them one by one?

Are you willing to use XML import? BulkEdit will "almost" do that now if you want to know about it. I will be cleaning it up next upgrade, but the cleanup can also be done manually if you want to try it (with all the normal cautions about backing up, etc.).

To give you a hint, the process would be:
- Export the 20 DVDs to XML
- Add a loan event
- Import the XML using BulkEdit

The messy part is that I forgot to set the due date properly, which I will fix on next update. So today, you have to go into Tools>Users and change the loan due dates manually.

Any concerns about the integrity of the online metadata on import can be solved by doing an Invelos refresh if you want to be sure.
Posted:
Topic Replies: 20, Topic Views: 8062
Quoting swamptours:
Quote:
This doesn't work. I still am unable to download the online profile.

You have not stated what the error message is, which would be helpful. But my advice would be to close DVD Profiler, make sure that you are not running low on disk space in your Documents folder, empty your recycle bin. Reboot your PC and apply any pending Microsoft updates, then you are likely to be OK.
Posted:
Topic Replies: 7, Topic Views: 4700
Quoting ateo357:
Quote:
Quoting mediadogg:
Quote:

I have mentioned this before. I would also consider being part of a "Save Profiler" consortium that would make some sort of financial offer to Invelos to either acquire rights to the online technology, or acquire equity in Invelos in return for funds that would allow hiring of staff to move forward in a limited way.



what do you think the annual cost to keep the program up and running would be?

Oh man, the only way I could possibly estimate that would be to break it down into categories, then given any assumptions you wanted to make, you could get a rough idea, for example:

- Assuming you pay for hosting, then estimate pure hosting costs - monthly fee, plus SSL, plus WHOIS, plus anti-virus, plus dedicated IP, plus domain name registration, etc. - est. $1000 USD / year or more (oops forgot we have no SSL - maybe now you know why - it costs money)

- Assuming paid technical staff - make your own estimate of the number of hours of support, web site maintenance, forum moderation and contributions management. Double the hourly rate if you are paying for employee benefits. Make your own assumptions about technical staff hourly rate, and how much can be offset by donated time from users.

- Same for programming support for bugs and new features

- Add fees for legal expenses and corporate registration, taxes and insurance

- Add fees, paperwork and time spent on Amazon and Apple store validation

- Add all the stuff I forgot

I'm willing to bet this could be a minimum  of 2000 USD yearly, not counting technical staff salaries.

If anybody thinks Invelos doesn't care, notice that a lot of these costs are being paid whether or not they are getting new business or making any updates. Somebody is paying it. Every day. Right now.
Posted:
Topic Replies: 48, Topic Views: 12733
Invelos Forums->Posts by mediadogg Page: 1... 17 18 19 20  Previous   Next