Support NeoGAF

Rlan · Oct 29, 2012

canIhasAnAccount said:
<3 to milkybar if he's been rumbled.

The website wasn't automatically scraping, just a bunch of static links. I mirrored it here if anyone wants a look.

Purely guessing here, but I expect you'd need PartnerNet access and have a setup to log all of the url requests being sent from the console. They'd probably ban IP's pretty fast if you just brute force it.

Vert boil · Oct 29, 2012

Rlan said:
If you actually look at the source for some of these, the images URLs are as follows:

There's actually very little difference in the URLs. If someone could sort out some sort of scraper that checks all URLs for artwork like that, you'd probably find some stuff that we haven't seen yet.

You are right, I just presumed the long codes would be fairly unique. *numpty*
I'll tinker over the next few weeks. Just knocked together a simple spreadsheet that poops out a string of html but it doesn't deal with the letter variants. I'll grab Open Office and simplify things in Base.

CrunchinJelly · Oct 29, 2012

Old school.

jon bones · Oct 29, 2012

toythatkills said:
Pid's out next week and looks good but could go either way

good lookin out... seems right up my alley!

Stumpokapow · Oct 29, 2012

Rlan said:
If you actually look at the source for some of these, the images URLs are as follows:

http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d80258410865/1033/boxartlg.jpg
http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d80258410861/1033/boxartlg.jpg
http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d80258410867/1033/boxartlg.jpg
http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d80258410868/1033/boxartlg.jpg
http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d80258410869/1033/boxartlg.jpg
http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d8025841086a/1033/boxartlg.jpg
http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d8025841086c/1033/boxartlg.jpg
http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d8025841086e/1033/boxartlg.jpg
http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d802584112a1/1033/boxartlg.jpg

There's actually very little differerence in the URLs. If someone could sort out some sort of scraper that checks all URLs for artwork like that, you'd probably find some stuff that we haven't seen yet.

Based solely on what you just said--running a search through the last four digits of the folder chunk of the URL...

Here's a scraper:

Code:

#!/usr/bin/php
<?php
	for($i=hexdec("7d2");$i!=hexdec("1fff");$i++)
	{
		$num = dechex($i);
		$num = str_pad($num,4,"0",STR_PAD_LEFT);
		$url = "http://download.xbox.com/content/images/66acd000-77fe-1000-9115-d8025841".$num."/1033/boxartlg.jpg";
		if(!file_exists("./boxarts/".$num.".jpg"))
		{
			$ch = curl_init($url);
			curl_setopt($ch,CURLOPT_HEADER,0);
			curl_setopt($ch,CURLOPT_RETURNTRANSFER,1);
			curl_setopt($ch,CURLOPT_BINARYTRANSFER,1);
			$data = curl_exec($ch);
			if(strlen($data)>50)
			{
				$output = fopen("./boxarts/".$num.".jpg","x");
				fwrite($output,$data);
				fclose($output);
	
				print "."; // Print . if there is a box art found.
			}
			else print "x"; // Print x if there is no box art found.
			if(rand(1,10)==10) sleep(rand(1,10)); // Anti-flooding protection, delays a random number of seconds every so often.
		}
	}
?>

System requirements: Server must have curl and be set up to be able to use curl. Put script in any folder. Create a subfolder called boxarts.

Code license: Please contact me if you plan to use this code to help run a website that makes you money. Otherwise, do what you want with it.

Last Baron · Oct 29, 2012

Wasn't Case Zero supposed to get a 50% discount in the Shocktober sale?

Vert boil · Oct 29, 2012

*Stump drops the mic*

Last Baron said:
Wasn't Case Zero supposed to get a 50% discount in the Shocktober sale?

I haven't seen anything coming from Capcpom or MS (unless you are referring to the general listing of horror related games on the marketplace). DR2 is the only DR bit reduced so far but there should be a second week of sales starting tomorrow.

Last Baron · Oct 29, 2012

canIhasAnAccount said:
*Stump drops the mic*

I haven't seen anything coming from Capcpom or MS (unless you are referring to the general listing of horror related games on the marketplace). DR2 is the only DR bit reduced so far but there should be a second week of sales starting tomorrow.

I saw it listed on a link from one of the deals aggregate sites I follow on Twitter I think. Hopefully it comes true because I just ordered OTR.

Rlan · Oct 29, 2012

You can also find screenshots for items if you change the name from boxartlg.jpg to screenlg1.jpg to screenlg#.jpg, depending on those screens.

They're not always there. Tried looking again at that Star Wars game, but nothing was there anymore.

So Crunchy, if you actually found those box arts using this method, could you find the screens too?

Edit: Found the boxes, however they don't have screenshots alongside them. Too bad.

milkybar1983 · Oct 30, 2012

I told you those kinect sports mini games were XBLA

achievements:

http://www.xbox360achievements.org/game/ski-race/achievements/

and fighting vipers:

http://www.xbox360achievements.org/game/fighting-vipers/achievements/

and to all those 'journalists' that labelled me a hacker, please do some research next time

CrunchinJelly · Oct 30, 2012

Rlan said:
You can also find screenshots for items if you change the name from boxartlg.jpg to screenlg1.jpg to screenlg#.jpg, depending on those screens.

They're not always there. Tried looking again at that Star Wars game, but nothing was there anymore.

So Crunchy, if you actually found those box arts using this method, could you find the screens too?

Edit: Found the boxes, however they don't have screenshots alongside them. Too bad.

I didn't find anything, I'm not that clever. Just saw Sacra posted them.

Vert boil · Oct 30, 2012

I'll update throughout the day.

DOTW

Oblivion - 800msp/10$ (was 1200/15$) US price, check your region
--Knights of Nine - 200msp (was 400)
--Shivering Isles - 600msp (was 1200)

Skyrim - 3600msp/45$ (was 4800/60$) US price, check your region
--Dawnguard - 1200msp (was 1600)
--Hearthfire - 320msp (was 400)

-----

Babel Rising - 400msp (was 800)

-----
Sales & Specials+ app

Dead Block - 400msp (was 800)
Dishwasher Vampire Smile - 400msp (was 800)
Torchlight - 600msp (was 1200)

eso76 · Oct 30, 2012

saw thread title and just remembered i had a dream in which Toki was finally coming out but devs had to downgrade graphics horribly in order to ship before 2014.

Strange dream, considering I don't even care about the game that much.

milkybar1983 · Oct 30, 2012

fresh scan: http://www.ghoz.tk/new_xbla.html

new shizz:

milkybar1983 · Oct 30, 2012

Vert boil · Oct 30, 2012

<3 Milkybar

Brothers: A Tale of Two Sons Interview with Josef Fares and gameplay - http://www.youtube.com/watch?v=_N5EosfNSfE

You control both characters in real time.

akilshohen · Oct 30, 2012

Isn't that the second time Babel has been on sale?

milkybar1983 · Oct 30, 2012

milkybar1983 · Oct 30, 2012

milkybar1983 · Oct 30, 2012

CrunchinJelly · Oct 30, 2012

Milkybar, you should probably re-host this stuff because it's gonna be a page of broken images in a day or two...

milkybar1983 · Oct 30, 2012

CrunchinJelly said:
Milkybar, you should probably re-host this stuff because it's gonna be a page of broken images in a day or two...

I'm too lazy

milkybar1983 · Oct 30, 2012

Vert boil · Oct 30, 2012

A little odd that the cut up Kinect Sports bits are apparently 50GS each and labelled as Arcade games. Probably planning to do another free hub like Games Room or Hasbro.

milkybar1983 · Oct 30, 2012

milkybar1983 · Oct 30, 2012

milkybar1983 · Oct 30, 2012

Rlan · Oct 30, 2012

The giant box art thing has made me realize that Joe Danger and it's sequel use the same picture of Joe:

Weird.

Gowans · Oct 30, 2012

Wow well done Milky an Stump for the code!

pswii60 · Oct 30, 2012

What's with all these new Arcade Kinect games? I thought Kinect was pretty much dead, sales-wise at least.

Anyway, out of that lot, Vessel and pid both look very interesting. The others, not so much.

milkybar1983 · Oct 30, 2012

milkybar1983 · Oct 30, 2012

milkybar1983 · Oct 30, 2012

milkybar1983 · Oct 30, 2012

Slayven · Oct 30, 2012

canIhasAnAccount said:
I'll update throughout the day.

DOTW

Oblivion - msp/$ (was 1200/15$) US price, check your region (should be 800msp)
--Knights of Nine - 200msp (was 400)
--Shivering Isles - 600msp (was 1200)

Skyrim - 3600msp/45$ (was 4800/60$) US price, check your region
--Dawnguard - 1200msp (was 1600)
--Hearthfire - 320msp (was 400)

-----

Babel Rising - 400msp (was 800)

-----
Sales & Specials+ app (updates 2 hours after this post)
**

Man Microsoft might think about having permanent price drops. No reason the Oblivion DLC should still be that much.

Stumpokapow · Oct 30, 2012

Weirdest random thing I've found by running that scraper:

milkybar1983 · Oct 30, 2012

Stumpokapow said:
Weirdest random thing I've found by running that scraper:

already in my link

Rlan · Oct 30, 2012

Stumpokapow said:
Weirdest random thing I've found by running that scraper:

You see those types of box arts on Partnernet all the time. Sometimes it's a game, sometimes it's not.

Wonder if the scraper works well for regular games too? You might find some weird stuff in there you wouldn't expect...

One thing I'm surprised isn't here is RBI baseball. I played it ages ago on a Partnernet machine, was real weird. Thought it had a box art. Even though it's cancelled, would have been nice to see it's actual existance.

Stumpokapow · Oct 30, 2012

Rlan said:
You see those types of box arts on Partnernet all the time. Sometimes it's a game, sometimes it's not.

Wonder if the scraper works well for regular games too? You might find some weird stuff in there you wouldn't expect...

Looks like at least the last 7 digits change for retail titles (and Dance Central 3 seems to have a different 8th last digit), so the scrape-space would be 268 million(+) rather than 65,536. So that'd be a royal pain to scrape.

milkybar1983 · Oct 30, 2012

Stumpokapow said:
Looks like at least the last 7 digits change for retail titles (and Dance Central 3 seems to have a different 8th last digit), so the scrape-space would be 268 million(+) rather than 65,536. So that'd be a royal pain to scrape.

its the same

Publisher code:

5841 = XA (xbox arcade)

or

4d53 = MS (microsoft)

then 4 digits title ID (65744 combinations)

here is full scan of Microsoft: http://www.ghoz.tk/ms_new.html (nothing interesting)

Seanspeed · Oct 30, 2012

Slayven said:
Man Microsoft might think about having permanent price drops. No reason the Oblivion DLC should still be that much.

I think Shivering Isles was like 2400 points or something before, so it has had a permanent price drop.

Nyx · Oct 30, 2012

milkybar1983 said:

Ah, the console DOTA.

Really interested in this.

Stumpokapow · Oct 30, 2012

milkybar1983 said:
its the same

Publisher code:

Well that's much easier, thanks for the tip!

milkybar1983 · Oct 30, 2012

Stumpokapow said:
Well that's much easier, thanks for the tip!

you won't finding anything juicy using retail IDs trust me

Gowans · Oct 30, 2012

Nyx said:
Ah, the console DOTA.

Really interested in this.

I have high hopes.

Dota 2 maybe my fave game of all time and the game where Mobas clicked for me.

Nyx · Oct 30, 2012

Gowans said:
I have high hopes.

Dota 2 maybe my fave game of all time and the game where Mobas clicked for me.

I need to play Dota 2 some more, but so many games....

The original DOTA in WCIII got me into the genre, Awesomenauts and League of Legends did the rest, love this genre.

CrunchinJelly · Oct 30, 2012

From MN

Pool Nation 31-Oct 800
Pid 31-Oct 800
Toe Jam & Earl Collection 7-Nov 800
Karateka 7-Nov 800

Karateka?

DOTW

6-Nov To 12-Nov

Guardian Heroes 600 (50% Off)
Joy Ride Turbo 600 (50% Off)
Shoot Many Robots 600 (50% Off)
All Zombies Must Die 600 (50% Off)

Slygmous · Oct 30, 2012

Wow Guardian Heroes! I hope more people pick it up, the game needs players online, I've never found a match.

Cheddahz · Oct 30, 2012

It's a crime to NOT pick up Guardian Heroes for that price, probably my favorite side-scrolling beat em' up

Vert boil · Oct 30, 2012

Those prices for next weeks DOTW are wrong. All of the games are 800msp so they should be 400msp at 50% off.

Support NeoGAF

XBLA (Xbox Live Arcade) News, Announcements, Reviews, and Impressions Thread

Member

Member

formerly cjelly

hot hot hanuman-on-man action

listen to the mad man

Member

Member

Member

Member

Member

formerly cjelly

Member

Member

Member

Member

Member

Member

Member

Member

Member

formerly cjelly

Member

Member

Member

Member

Member

Member

Member

Member

Member

Member

Member

Member

Member

Member

listen to the mad man

Member

Member

listen to the mad man

Member

Banned

Member

listen to the mad man

Member

Member

Member

formerly cjelly

Member

Banned

Member

Similar threads