Question on beta testers

pocatellodave · 05-19-07, 07:22 AM

I was wondering if SHIV had any ...tongue in cheek...beta testers.

It's just that I recall some of the sim companies using volunteers to check out their products for bugs.I never was a beta tester,as I recall it seems you needed to have a lot of credentials to get to be one.It would appear that Ubisoft didn't have beta testers,as I'm sure a lot of the bugs would have been caught.I'm sitting here thinking with the latest from Ubisoft being there may not be a 1.3 patch,and the mention of a class act law suit.Having a few free beta testers might have been a pretty good idea.I like playing SHIV,and the bugs don't bother me that much,as I'm just a dweeb,and play on 65% realism settings,but that is fun for me.This whole issue kind of reminds me of Eurofighter,and the microprose thingy.Talk about screaming for a patch.

Ahhhh the glory years of simming.
Pocatellodave

AVGWarhawk · 05-19-07, 07:25 AM

Simply put, yes. Look at the time line. Game went gold(off to producers for copies to sell). Game played by beta testers in the mean time. With in less than 2 days after the game was in our grubby hands the first patch was out. The developers were making the first patch while the game was being copied to DVD for sale. This rather large patch was not made in two days. It was developed by the first testers. At least that is how it looks to me.

mr chris · 05-19-07, 07:53 AM

What a sorry state of affairs the devs knew how bad the game was and still let it get sent out to the stores

Also why we are on the subject false advertisting which is what the devs and Ubi a guilty of. SS.com is also far from whiter than white. On the back of my copy of the game it says, "SILENT HUNTER 4 IS A KNOCKOUT" Subsim.com
Well i would like to find the guy who said that of a game when we are all honest is worse and has more bugs out of the box than SH3 had. The Devs had years to fix the bugs that they knew from SH3 and really go to town on the game but instaed they have just made a pacfic add on to SH3 and called it SH4 very poor show from everyone invouled.

AVGWarhawk · 05-19-07, 07:59 AM

Quote:

What a sorry state of affairs the devs knew how bad the game was and still let it get sent out to the stores

Devs did not make the cut off date. Apparently preset under contract to have it on the shelves for sale on the date promised. This is how it looks. Game went out unfinished, patch in the works while they produced it. Patch out day two after sale.

Quote:

Also why we are on the subject false advertisting which is what the devs and Ubi a guilty of. SS.com is also far from whiter than white. On the back of my copy of the game it says, "SILENT HUNTER 4 IS A KNOCKOUT" Subsim.com
Well i would like to find the guy who said that of a game when we are all honest is worse and has more bugs out of the box than SH3 had. The Devs had years to fix the bugs that they knew from SH3 and really go to town on the game but instaed they have just made a pacfic add on to SH3 and called it SH4 very poor show from everyone invouled.

IMHO the game is a knockout. I can think of many great things about it than bad things about it. I need basically one fix...the radar. Nothing else bothers me with it. I have three mods at the moment. Two texture mods for the interface and the reduced radio traffic mod for the clipboard. So my game is basically vanilla. If the vanilla is this good in my eyes, it will only get better when the modders dig in. They already have

mr chris · 05-19-07, 08:07 AM

IMHO it is a very lazy effort. They could have done so so much but they just did the bear minium to the game. Knowing that the coummuinty would take care of the rest with the great modders it holds. If the Modders here can do such a good job in such a short space of time. Why have they done so little in so much time??
Everyone around here is so fast to get in Ubi back and they do deserve the crap they get but the devs are very far from blameless.

AVGWarhawk · 05-19-07, 08:19 AM

Quote:

Originally Posted by mr chris

IMHO it is a very lazy effort. They could have done so so much but they just did the bear minium to the game. Knowing that the coummuinty would take care of the rest with the great modders it holds. If the Modders here can do such a good job in such a short space of time. Why have they done so little in so much time??
Everyone around here is so fast to get in Ubi back and they do deserve the crap they get but the devs are very far from blameless.

I agree. To think a game of this magnitude could be done in the time alloted by any stretch of the imagination was just bad foresight. Perhaps they thought it would take less time as they based it on the SH3 engine and half the work was done. Looked good at the time I'm sure. As it pans out, it was a bad decision. The modders can only do so much when the bug issues are hard coded. This we have to leave up to the developers. Hopefully they choose to work on it.

I'm the type of person that if I make a mistake in my business world, I do everything to correct it to the customer satisfaction and even if it costs me financially. I hope this sentiment is the same with UBI.

Onkel Neal · 05-19-07, 06:03 PM

Quote:

Originally Posted by mr chris

Also why we are on the subject false advertisting which is what the devs and Ubi a guilty of. SS.com is also far from whiter than white. On the back of my copy of the game it says, "SILENT HUNTER 4 IS A KNOCKOUT" Subsim.com
Well i would like to find the guy who said that of a game when we are all honest is worse and has more bugs out of the box than SH3 had.

That was me. Go ahead, read the whole paragraph.

Oh, here, let me help you:

Quote:

I can't vouch for the AI or deeper levels of gameplay from an hour in the Ubisoft media center, but visually, Silent Hunter 4 is a knockout. The dev team has covered a lot of ground in just nine months. They've refined and improved many facets of the game such as crew management, multiplayer, harbor activity, crew models, and radio traffic, and added new things like dynamic objectives, special missions, and most importantly, simulated the US submarine war in the Pacific theater. After eleven years, Silent Hunter is returning to do battle with the mighty Empire of the Rising Sun. This is one fight you do not want to miss.

Now, see how things look when you put them in context?

http://www.subsim.com/sh4/demo_sh4.php

pocatellodave · 05-19-07, 06:40 PM

Thanks for all the comments and information.I wasn't trying to get a wheres the patch or SHIV is a buggy mess thread going.From the facts I garnered,it appears SHIV biggest problem was the time frame.The hurrier I get the behinder I get syndrome.We are soooo fortunate to have cabable modders to help sooth are woes.If I was running a sim company,I'd be having these fellas work for me,and I'll bet I could put out a real nice subsim

Pocatellodave

TDK1044 · 05-19-07, 09:13 PM

The saddest thing about all this to me, is that if Ubisoft make good sales on the game then they'll pull this nonsense the next time. And if they don't make good sales on the game then there won't be a next time.

mr chris · 05-20-07, 06:46 AM

Quote:

Originally Posted by Neal Stevens

Quote:

Originally Posted by mr chris

Also why we are on the subject false advertisting which is what the devs and Ubi a guilty of. SS.com is also far from whiter than white. On the back of my copy of the game it says, "SILENT HUNTER 4 IS A KNOCKOUT" Subsim.com
Well i would like to find the guy who said that of a game when we are all honest is worse and has more bugs out of the box than SH3 had.

That was me. Go ahead, read the whole paragraph.

Oh, here, let me help you:

Quote:

I can't vouch for the AI or deeper levels of gameplay from an hour in the Ubisoft media center, but visually, Silent Hunter 4 is a knockout. The dev team has covered a lot of ground in just nine months. They've refined and improved many facets of the game such as crew management, multiplayer, harbor activity, crew models, and radio traffic, and added new things like dynamic objectives, special missions, and most importantly, simulated the US submarine war in the Pacific theater. After eleven years, Silent Hunter is returning to do battle with the mighty Empire of the Rising Sun. This is one fight you do not want to miss.

Now, see how things look when you put them in context?

http://www.subsim.com/sh4/demo_sh4.php

Well thats not what its says on the back of my game Neal.

Its says and i quote

"SILENT HUNTER 4 IS A KNOCKOUT"
subsim.com

:hmm::hmm

o you not think that is is not slightly missleading as it does not seem to have a link on the back of the game box to the paragraph that you just posted.

Maybe you should have held back on the sweeping statements before you had a proper chance to play the game away from the beady eyes of UBI HQ.

heartc · 05-20-07, 07:01 AM

You will not find a company compromising their own advertisement. Ever.

Look at any game boxes where they quote reviewers. It has always been done like that, taking quotes out of context and only quoting the good parts - albeit I agree in this specific example it's pretty bad since the quote is not just taken out of context, but presented as a broad statement which was never stated as such.

Now, as a reviewer, you can either not say anything positive at all in your review because of that or live with it and trust the people know what "advertisment" means.

And really, in my opinion SHIV is not anywhere near as bad as the hysterical masses get themselves hyped up on.

VonBlade · 05-20-07, 09:13 AM

Quote:

Originally Posted by mr chris

Well thats not what its says on the back of my game Neal.

Its says and i quote
"SILENT HUNTER 4 IS A KNOCKOUT"
subsim.com
:hmm::hmm

o you not think that is is not slightly missleading

Well duh.

Mr Stevens could have written "The sheer volume of bugs and unfinished features in Silent Hunter 4 is a good enough reason to knock you out of purchasing it and go upto UBI with a pitchfork and a torch".

Yet you could still edit it to read "Silent Hunter 4 is a knockout".
VB

Ducimus · 05-19-07, 04:42 PM

Quote:

Originally Posted by pocatellodave

I was wondering if SHIV had any ...tongue in cheek...beta testers.

It's just that I recall some of the sim companies using volunteers to check out their products for bugs.

Yes they did. Many of the beta testers, were infact from subsim.com. I, as well as a few others here (to know who they were, all you have to do is watch the credits, their listed there) were approached by the devs, asking if we were interested in beta testing SH4. NDA rules applied, so beta testers can't and wont tell you much.

While i had the opportunity, in the end, i passed on it because i didnt have the time to give it the proper attention it deserved. (that and i didnt want to burn myself out from beta, before i had the real thing in my hand). So the following statement is a guess on my part. I don't think it was an failure on beta testing, or on the testers part. Who better to test it, then some of the grognards from this very community? I think the devs knew full well the bug reports, but due to time and money constraints placed upon them by the stuffed suits at Ubi Headquarters, had to prioritize which bugs to address, and which ones to let go. I really think the devs knew fully (and probably painfully) well the state of the game when it was released.

I personally, blame the timeline and budgetary decisions made by the corporate suits more then id blame the code monkey chained to his cube trying to meet an imposed deadline.

IRONxMortlock · 05-19-07, 05:00 PM

Can I say it? Can I?

Told you so!
http://www.subsim.com/radioroom/show...5&postcount=22
http://www.subsim.com/radioroom/show...4&postcount=14

TheSatyr · 05-19-07, 05:37 PM

I think everyone who plays pc games should be a beta tester at some point in their lives. Then they would understand the relationship between devs and production companies such as Ubi. I was one for 3 years and can give you some real good reasons why the game is in the state it's in.

1)The devs were given a due date for finishing the code. And if they didn't finish by that time they would have taken a financial hit. (The company I tested for took a 250K$ hit for being a month late,which damn near whiped out any profit they would have made).

2)Just cause a product is beta tested doesn't mean the bugs will be fixed before the product goes gold. Again you have the time constraints with having to go gold by a certain date,and financial considerations. Dev companies aren't usually rich. To make a patch requires funds for paying the programmers and unless you are a company like Blizzard,that money has to came from the company that hired the dev comany. I'm surprised Ubi got two patches out as soon as they did all things considered. That shows me that both the Devs and beta testers know what they are doing,and that they have their own internal lists for things that need to be fixed.

3)I'm not sure about Ubi,but alot of these companies have to answer to stockholders which means THEY have to rush out products faster then they might like just to keep the stockholders off their backs.

Finally,the testing/patching process is a bit complicated. First you get a patch build with some fixes,test it,list which things are fixed and which isn't,then the devs put together their own prioritized list,easiest fixes first,hardcoded fixes at the bottom(From what a dev told me,the last thing they want to do is screw around in the hardcoded stuff. It's time consuming and any mistake could totally bork everything up to and including causing the OS itself to fail). Then you get the next patch build and go through the process again which is repeated till the testers and the devs are satisfied. After that it goes to the production company,in this case Ubi,whose Q/A testers spend a week or two testing the patch and they decide whether it gets released or whether they send it back to the Devs for more work.(Which is what happened with Sega and MTWII a while back. Their Q/A found a problem with the 1.2 patch and sent it back to Creative for more work).

Bottom line,it takes time and money to make a patch,and for a make or break patch like 1.3 would be, the more time we and Ubi give the Devs to make the patch, the better the patch will be. If,of course,Ubi authorizes a 1.3 patch. But I ain't going there.

05-19-07, 07:22 AM	#1
pocatellodave Engineer Join Date: May 2005 Location: Pocatello,ID Posts: 203 Downloads: 92 Uploads: 0	Question on beta testers I was wondering if SHIV had any ...tongue in cheek...beta testers. It's just that I recall some of the sim companies using volunteers to check out their products for bugs.I never was a beta tester,as I recall it seems you needed to have a lot of credentials to get to be one.It would appear that Ubisoft didn't have beta testers,as I'm sure a lot of the bugs would have been caught.I'm sitting here thinking with the latest from Ubisoft being there may not be a 1.3 patch,and the mention of a class act law suit.Having a few free beta testers might have been a pretty good idea.I like playing SHIV,and the bugs don't bother me that much,as I'm just a dweeb,and play on 65% realism settings,but that is fun for me.This whole issue kind of reminds me of Eurofighter,and the microprose thingy.Talk about screaming for a patch. Ahhhh the glory years of simming. Pocatellodave

05-19-07, 07:25 AM	#2
AVGWarhawk Lucky Jack Join Date: Jun 2005 Location: In a 1954 Buick. Posts: 28,253 Downloads: 90 Uploads: 0	Simply put, yes. Look at the time line. Game went gold(off to producers for copies to sell). Game played by beta testers in the mean time. With in less than 2 days after the game was in our grubby hands the first patch was out. The developers were making the first patch while the game was being copied to DVD for sale. This rather large patch was not made in two days. It was developed by the first testers. At least that is how it looks to me. __________________ “You're painfully alive in a drugged and dying culture.” ― Richard Yates, Revolutionary Road

05-19-07, 07:53 AM	#3
mr chris Silent Hunter Join Date: Apr 2005 Location: Herefordshire, England Posts: 3,562 Downloads: 216 Uploads: 0	What a sorry state of affairs the devs knew how bad the game was and still let it get sent out to the stores Also why we are on the subject false advertisting which is what the devs and Ubi a guilty of. SS.com is also far from whiter than white. On the back of my copy of the game it says, "SILENT HUNTER 4 IS A KNOCKOUT" Subsim.com Well i would like to find the guy who said that of a game when we are all honest is worse and has more bugs out of the box than SH3 had. The Devs had years to fix the bugs that they knew from SH3 and really go to town on the game but instaed they have just made a pacfic add on to SH3 and called it SH4 very poor show from everyone invouled. __________________

05-19-07, 08:07 AM	#5
mr chris Silent Hunter Join Date: Apr 2005 Location: Herefordshire, England Posts: 3,562 Downloads: 216 Uploads: 0	IMHO it is a very lazy effort. They could have done so so much but they just did the bear minium to the game. Knowing that the coummuinty would take care of the rest with the great modders it holds. If the Modders here can do such a good job in such a short space of time. Why have they done so little in so much time?? Everyone around here is so fast to get in Ubi back and they do deserve the crap they get but the devs are very far from blameless. __________________

05-19-07, 05:00 PM	#14
IRONxMortlock Watch Officer Join Date: Oct 2005 Location: Queensland, Australia Posts: 339 Downloads: 1 Uploads: 0	Can I say it? Can I? Told you so! http://www.subsim.com/radioroom/show...5&postcount=22 http://www.subsim.com/radioroom/show...4&postcount=14 __________________ GWX Careers Oberleutnant Walter Pasche - 10th flotila - Feb 1 1942~June 30 1942 - 33 ships sunk for 308020tons - KIA (DC attack). Kapitanleutnant Karl Brauch - 1st flotila - Sep 5 1939~

05-19-07, 06:40 PM	#8
pocatellodave Engineer Join Date: May 2005 Location: Pocatello,ID Posts: 203 Downloads: 92 Uploads: 0	Thanks for all the comments and information.I wasn't trying to get a wheres the patch or SHIV is a buggy mess thread going.From the facts I garnered,it appears SHIV biggest problem was the time frame.The hurrier I get the behinder I get syndrome.We are soooo fortunate to have cabable modders to help sooth are woes.If I was running a sim company,I'd be having these fellas work for me,and I'll bet I could put out a real nice subsim Pocatellodave

05-19-07, 09:13 PM	#9
TDK1044 Ocean Warrior Join Date: Mar 2005 Location: Georgia, USA Posts: 2,674 Downloads: 25 Uploads: 0	The saddest thing about all this to me, is that if Ubisoft make good sales on the game then they'll pull this nonsense the next time. And if they don't make good sales on the game then there won't be a next time.

05-20-07, 07:01 AM	#11
heartc Samurai Navy Join Date: Dec 2006 Location: Munich Posts: 562 Downloads: 71 Uploads: 0	You will not find a company compromising their own advertisement. Ever. Look at any game boxes where they quote reviewers. It has always been done like that, taking quotes out of context and only quoting the good parts - albeit I agree in this specific example it's pretty bad since the quote is not just taken out of context, but presented as a broad statement which was never stated as such. Now, as a reviewer, you can either not say anything positive at all in your review because of that or live with it and trust the people know what "advertisment" means. And really, in my opinion SHIV is not anywhere near as bad as the hysterical masses get themselves hyped up on.

05-19-07, 05:37 PM	#15
TheSatyr Captain Join Date: Apr 2002 Posts: 545 Downloads: 0 Uploads: 0	I think everyone who plays pc games should be a beta tester at some point in their lives. Then they would understand the relationship between devs and production companies such as Ubi. I was one for 3 years and can give you some real good reasons why the game is in the state it's in. 1)The devs were given a due date for finishing the code. And if they didn't finish by that time they would have taken a financial hit. (The company I tested for took a 250K$ hit for being a month late,which damn near whiped out any profit they would have made). 2)Just cause a product is beta tested doesn't mean the bugs will be fixed before the product goes gold. Again you have the time constraints with having to go gold by a certain date,and financial considerations. Dev companies aren't usually rich. To make a patch requires funds for paying the programmers and unless you are a company like Blizzard,that money has to came from the company that hired the dev comany. I'm surprised Ubi got two patches out as soon as they did all things considered. That shows me that both the Devs and beta testers know what they are doing,and that they have their own internal lists for things that need to be fixed. 3)I'm not sure about Ubi,but alot of these companies have to answer to stockholders which means THEY have to rush out products faster then they might like just to keep the stockholders off their backs. Finally,the testing/patching process is a bit complicated. First you get a patch build with some fixes,test it,list which things are fixed and which isn't,then the devs put together their own prioritized list,easiest fixes first,hardcoded fixes at the bottom(From what a dev told me,the last thing they want to do is screw around in the hardcoded stuff. It's time consuming and any mistake could totally bork everything up to and including causing the OS itself to fail). Then you get the next patch build and go through the process again which is repeated till the testers and the devs are satisfied. After that it goes to the production company,in this case Ubi,whose Q/A testers spend a week or two testing the patch and they decide whether it gets released or whether they send it back to the Devs for more work.(Which is what happened with Sega and MTWII a while back. Their Q/A found a problem with the 1.2 patch and sent it back to Creative for more work). Bottom line,it takes time and money to make a patch,and for a make or break patch like 1.3 would be, the more time we and Ubi give the Devs to make the patch, the better the patch will be. If,of course,Ubi authorizes a 1.3 patch. But I ain't going there.