The midnight coder

Seagate Dockstar - Install Debian Linux

2010-12-01T16:20:00.060-05:00

Step 1: Disable the Pogoplug services
- SSH into the DockStar
- command: "killall hbwd"

Step 2: Attach and configure the USB device
- use fdisk (instructions here)
- create 2 partitions: 1st partition type 83 (Linux), second partition type 82 (Linux Swap)
- mark partition 1 as bootable

Step 3: Install Debian Linux
- use instructions here
- this will take a while, after it is finished it will ask you to reboot
- log back in using SSH (PuTTY)

If the device does not boot into your new Debian install, you maye have a USB stick that is not suitable for booting from it. Try a "warm boot" by using a pen to push the "Reset" button on the right side of the DockStar.).
The device may have a different IP address now (check that using your router)
to troubleshoot you can use netconsole as described here

- change root password using "passwd" command
- change the host name by editing the file "/etc/hostname" using vi or nano
- set the timezone by using "dpkg-reconfigure tzdata"
- optionally, install an updated Kernel from here

Step 4: Additional Configuration
- install nano editor "apt-get install nano"
- install sudo with "apt-get install sudo"
- add additional users with "adduser"
- install other packages for internet radio, samba, I2C etc. (will be covered in later posts)

Step 5: make a copy/backup of your system
If you have the system configured and running, you can make a backup copy onto another USB stick with the following command:

dd if=/dev/sda of=/dev/sdb

This assumes that the boot USB drive is /dev/sda and the traget drive is /dev/sdb
ALL DATA ON /dev/sdb WILL BE ERASED!

Related links:
DIY Audio - hackable linux (openWRT) ethernet board
http://www.mikrocontroller.net/articles/Dockstar
http://ahsoftware.de/dockstar/
http://www.rudiswiki.de/wiki/DockStarDebian
Ten(ish) steps to setting up a Seagate Dockstar
http://anwendungsentwickler.ws/dockstar_freeagent_bekommt_zuwachs/entry/316/

VB.Net and Optional Parameters - watch out!

2008-12-16T12:04:00.004-05:00

I read somewhere recently that C# 4.0 will also have optional parameters, like VB6 and VB.Net had all along.
When moving to .Net I decided not to use optional parameters in VB.net since they were kind of looked at as a remnant of VB6, not CLR compliant, not available in C# etc.

And the "preferred way" was to use overloads instead of Optional Parameters.

So now after I read that C# 4.0 will have optional parameters (and the fact that I am kind of "over" the many overloads that are sometimes necessary, especially if you have logging methods etc.) I was thinking of going back to using Optional Parameters.

I always assumed that the compiler for VB.Net would just created the overloads in the background, substituting it with the default values given to the Optional Parameters.

But that is not the case. The compile hard-compiles the default values into the CALLING method/object and not as an overload into the called method.

Joel On Software

VB.NET Optional parameters

Optional Parameters (VB.NET)

Now this was a big red flag for me, because that means each time you change the value of one of the default parameters, you would need to recompile ALL the CALLING classes as well (if they call with some of the optional parameters omitted).

So if you have a live enterprise system with multiple DLLs and you need to deploy hotfixes as individual DLLs then you'd have to deploy the changed DLL and all the DLLs that call it. Otherwise the "old" DLLs will still call your method with the "old" default value and this could introduce some hard-to-find side effects.

One might argue how often do you really need to change the default value of an Optional Parameter and that that indicates a deeper design issue.
But still, for complex system or legacy code that you are refactoring this might be a real possibility.

Furthermore in VB.Net 3.5 you cannot use Nullable types as optional parameters, i.e. you cannot do this:

Public Sub DoStuff(Optional ByVal intEntityID As Nullable(Of Integer) = Nothing)

End Sub

So my conclusion at this point is to stick with overloads instead of Optional Parameters. More predictable and less things to remember as possible pitfalls. :)
I got enough other stuff to cram into my head ...

HTTP concurrent connections from IE - AJAX

2008-11-13T08:46:00.003-05:00

I have been stumbling across articles about the two-concurrent-connection limit of IE7 recently.
Tools like the Visual Round Trip Analyzer from Microsoft also mention this in the set of criteria they evaluate against.
It seems that in IE8 the limit of 2 connections is increased to 6 as per here:
AJAX - Connectivity Enhancements in Internet Explorer 8

But it can also be tweaked in IE7 and below as decsribed in the KB article:
http://support.microsoft.com/kb/183110

Other links:
12 Steps To Faster Web Pages With Visual Round Trip Analyzer

Case Study: Much ado about Browser's HTTP connection

Nested JOINS (mix of inner and outer joins in SQL)

2008-11-07T17:02:00.006-05:00

I just ran into this today:
Be Careful When Mixing INNER and OUTER Joins

It's not rocket science, but it can be somewhat counter-intuitive. How to tell the SQL server query engine what you want as an inner join vs an outer join.

I ended up using the nested join syntax by the way, seems cleanest to me and is not relying on the position of the JOIN line in the query.

Basically:

select People.PersonName, Pets.PetName, PetTypes.PetType
from People
left outer join
(Pets inner join PetTypes on Pets.PetTypeID = PetTypes.PetTypeID)
on Pets.OwnerID = People.PersonID

Stored Procedures - Best Practices

2008-11-03T08:40:00.001-05:00

Excellent post where Aaron Bertrand shares his best practices for developing stored procedures covering both coding style as well as some coding best practices (good use of NOCOUNT etc).

http://sqlblog.com/blogs/aaron_bertrand/archive/2008/10/30/my-stored-procedure-best-practices-checklist.aspx

Windows Azure - behold the cloud

2008-11-03T08:38:00.006-05:00

A lot of buzz is being generated at the moment about the Microsoft Azure Services platform. Here is a brief collection of links to get started on it.

Microsoft’s official Azure site, containing links to the key parts of the platform and documentation:
http://www.microsoft.com/azure/default.mspx

Microsoft's official press release:
http://www.microsoft.com/presspass/press/2008/oct08/10-27PDCDay1PR.mspx

Overview blog post by Paul Gielens:
http://weblogs.asp.net/pgielens/archive/2008/10/27/a-lap-around-windows-azure.aspx

Some details on how the Windows Azure back end infrastructure is laid out:
http://blogs.msdn.com/domgreen/archive/2008/10/30/windows-azure-back-end.aspx

Getting Started with Windows Azure - The Cloud Computing Tools Team has a nice post gathering together the downloads, tools and some information about the tools and SDK:
http://blogs.msdn.com/cloud/archive/2008/10/27/getting-started-windows-azure-tools-for-microsoft-visual-studio.aspx

Here's a tutorial on the process of storing information in Azure with plenty of screenshots and code samples included in the post:
http://blogs.msdn.com/jnak/archive/2008/10/29/walkthrough-simple-blob-storage-sample.aspx

A tutorial on the process of getting up and running with Azure, from setting up the development environment to publishing your first application:
http://blogs.msdn.com/olavt/archive/2008/10/30/how-to-create-and-publish-your-first-windows-azure-application.aspx

Clemens Vasters blogs about the Microsoft .Net ServiceBus that is part of the Azure platform:
http://vasters.com/clemensv/PermaLink,guid,92d78bee-2cfd-4a29-95ab-c5abb9b905e7.aspx

Copy data between 2 SQL servers - Take 2

2008-08-05T02:03:00.004-04:00

Alright, so one of the issues my previous post did not address was the treatment of Identity columns when using BCP and BULK import.
By default, identity column data is not part of a BCP export, so when doing a BULK IMPORT SQL server will assign new values to the identity Column .
Fortunately, that is relatively easy to address, as decribed here:
http://msdn.microsoft.com/en-us/library/ms186335.aspx

Basically when doing a BCP export, add the "-E" parameter.

Example:
bcp Northwind.dbo.Authors out C:\Temp\DataExport.dat -n -E -T -S MPDESKTOP\SQL2005

And when importing, use the KEEPIDENTITY parameter in the BULK INSERT like this:

USE Northwind
GO
BULK INSERT Authors
FROM 'G:\Transfer\Tempfiles\DataExport.dat'
WITH (KEEPIDENTITY, DATAFILETYPE='native');
GO

This will preserve the values of identity columns when copying data between 2 servers/databases. Keep in mind that there still might be issue with referential integrity constraints etc. that you need to address when moving data between databases.

Updating the Main UI from a different thread

2008-06-10T12:07:00.004-04:00

As you probably know, the availability of threading in .Net can lead to all kinds of little surprises, together of course with the power to write much more responsive applications.
For instance if you have a WinForms app that spawns a worker thread, and then that worker thread needs to update any UI elements on the main form, it will not work, since you can only update UI elements from the same thread they are created on.
I specifically ran into this when using a custom NUnit TestRunner (see previous post). It turns out, the TestRunner runs the test fixtures on a different thread, so you can't just do a frmMain.txtMessage.Text = "New Text from Test Fixture". Would have been too easy.

In addition, VB.Net also has the concept of default form instances, so when you do the above "frmMain.txtMessage" from a different thread than the main UI thread, VB.Net actually instantiates a new form, and then discards it when you are done. Thus there will be no exception raised for the above code, and putting in a brekpoint in the work thread shows the text properly updated. But in the UI the textbox will be empty.
It is much better explained in this post.

But the gist of it is this:

1. You have to use My.Application.OpenForms to get the correct UI thread instance of your form that you want to update

2. you have to use Invoke/BeginInvoke together with delegates to properly update the controls on the Main UI thread from a different thread.

3. The Control base class has a neat little method called InvokeRequired that will return True if the method is called from a different thread. This way you can write a generic function that works both on the UI thread and from other threads. Something like this:

Public Class frmMain

   'some magic voodo that needs to be done here to allow updating of the text box from a different thread
   Private Delegate Sub PostMessageDelegate(ByVal strNewMessage As String)

   'this is part 2 of the magic voodo: this is a public method that will be called on this form from the
   'outside, from different threads, so the text box can be updated
   Public Sub PostMessage(ByVal strMessage As String)
     If txtMessages.InvokeRequired Then
       'this method is called form a different thread, so we need to use BeginInvoke to update the UI
       txtMessages.BeginInvoke(New PostMessageDelegate(AddressOf PostMessage), New Object() {strMessage})
     Else
       txtMessages.Text &= Environment.NewLine & strMessage
     End If
   End Sub
...

End Class

Implement your own NUnit TestRunner - Part 2

2008-06-10T08:41:00.007-04:00

After I blogged about creating a basic NUnit TestRunner in Part 1 of this series, this is the follow-up that shows how to extract and display the test results in a simple fashion.
Basically the TestResult object that is being returned from the Run method of the TestRunner contains probably most of the information you need.
Here is the Code:

Imports System.Text
Imports System.Xml
Imports System.IO
Imports System.Reflection
Imports System.Resources
Imports NUnit.Core
Imports NUnit.Util

Public Class Form1

   Private Sub btnRunTests_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles btnRunTests.Click

     Dim objTestRunner As TestRunner = Nothing

     objTestRunner = New RemoteTestRunner()

     Dim strMyFileName As String = Assembly.GetExecutingAssembly().Location
     Dim objPackage As TestPackage = New TestPackage(strMyFileName)

     objTestRunner.Load(objPackage)

     'run the test and create the result
     Dim objTestResult As TestResult = objTestRunner.Run(New NullListener)

     'get the result summary in XML format
     Dim strResultSummary As String = CreateXmlOutput(objTestResult)

     'now transform the XML into more display-friendly code using the default style sheet
     Dim sbResultSummary As New StringBuilder

     Dim objXFormReader As XmlTextReader = GetTransformReader(Nothing)
     Dim objXMLXform As XmlResultTransform = New XmlResultTransform(objXFormReader)
     objXMLXform.Transform(New StringReader(strResultSummary), New StringWriter(sbResultSummary))

     txtResults.Text = sbResultSummary.ToString()

   End Sub

   Private Shared Function CreateXmlOutput(ByVal objResult As TestResult) As String

     Dim sbXML As New StringBuilder()
     Dim objResultVisitor As New XmlResultVisitor(New StringWriter(sbXML), objResult)
     objResult.Accept(objResultVisitor)
     objResultVisitor.Write()

     Return sbXML.ToString()

   End Function 'CreateXmlOutput

   Private Shared Function GetTransformReader(ByVal strXSLFileName As String) As XmlTextReader

     Dim objXMLReader As XmlTextReader = Nothing
     If String.IsNullOrEmpty(strXSLFileName) Then
       Dim objNUnitAssembly As Assembly = Assembly.GetAssembly(GetType(XmlResultVisitor))
       Dim objResourceMgr As New ResourceManager("NUnit.Util.Transform", objNUnitAssembly)
       Dim strXmlData As String = CStr(objResourceMgr.GetObject("Summary.xslt"))

       objXMLReader = New XmlTextReader(New StringReader(strXmlData))
     Else
       Dim objXsltInfo As New FileInfo(strXSLFileName)
       If Not objXsltInfo.Exists Then
         Throw New FileNotFoundException("Transform file: {0} does not exist", objXsltInfo.FullName)
         objXMLReader = Nothing
       Else
         objXMLReader = New XmlTextReader(objXsltInfo.FullName)
       End If
     End If

     Return objXMLReader
   End Function 'GetTransformReader

End Class

this will then show the results in a user-friendly form in the text box txtResults.
Where this comes in handy is if you have a WinForms App and you want to run your Unit tests as part of the WinForms app without having to launch the NUnit GUI (or Console).
This is admittedly a very simple implementation, does not have a lot of the bells and whistles of a more graphical UI, but it tells you which tests failed and how long they took and where they failed.

Implement your own NUnit TestRunner - Part 1

2008-06-10T00:43:00.009-04:00

I wanted to be able to run NUnit unit tests from my own test runner within a WinForms App. Easier said than done, not a lot of examples out there. I looked through the NUnit-Console code and the NUnit-Gui code and pieced together bits and pieces. Then I also stumbled across this blog post from a fellow german which helped with the last stumbling block:
http://achblah.blogspot.com/2007/04/monocov-and-my-contribution-to-it.html

The end result is this piece of VB.net code that will run any tests within your current EXE:

Imports System.Reflection
Imports NUnit.Core
Imports NUnit.Util

Public Class Form1

  Private Sub btnRunTests_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles btnRunTests.Click

    Dim objTestRunner As TestRunner = Nothing

    objTestRunner = New RemoteTestRunner()

    Dim strMyFileName As String = Assembly.GetExecutingAssembly().Location
    Dim objPackage As TestPackage = New TestPackage(strMyFileName)

    objTestRunner.Load(objPackage)

    objTestRunner.Run(New NullListener)

  End Sub
End Class

Of course this does not show any test results or exceptions because of using the "NullListener". In Part 2 I will fix that.

Life Cycle of static variables in ASP.Net

2008-04-18T08:19:00.003-04:00

Have you ever wondered about the scope and life time of static (Shared in VB.Net) variables in ASP.Net?
- Do they get destroyed after each requests?
- Do they get destroyed after the IIS services is restarted?
- multiple apps run in the same Application Pool, do they all get the same copy (and value) of static variables?
- Does a Singleton make sense in ASP.Net

Here is what I could gather from doing some research on the web:

- static variables work in ASP.Net the same way they work in a Windows app: they are global across the whole .Net AppDomain
- each ASP.Net application gets their own AppDomain, even if they are hosted in the same application pool (same w3wp.exe or aspnet_wp.exe)
- so even if you have multiple ASP.Net applications per Application Pool, they would still get their own AppDomains, and thus the singletons/shared variables would be isolated from each other

Some people encourage initializing the singletons/static variables in the Application_Startup event, just to make sure that all the ASP.Net infrastructure.

Here are some supporting links:

http://weblogs.asp.net/jeff/archive/2007/09/21/how-do-you-get-a-true-singleton-in-an-asp-net-app.aspx

http://www.odetocode.com/Articles/305.aspx

http://blogs.msdn.com/david.wang/archive/2005/09/01/HOWTO-Provision-ASP-dotNet-AppDomains-and-IIS6-Application-Pools.aspx

http://www.vzyl.co.za/post/2008/04/Singleton-Design-Pattern-amp3b-Lifetime-of-a-static-variable-in-ASPNET-20.aspx

http://www.yoda.arachsys.com/csharp/singleton.html

BLowery Compression module and Visual Studio Webserver (Cassini)

2007-11-16T10:29:00.000-05:00

We have been using the HTTPCompress module (BLowery), and when running your web site in development mode using the built-in web server in Visual Studio 2005 you can get the error "Server cannot append header after HTTP headers have been sent." in cases where you want to do a Response.Flush (e.g. for downloading a file to the client).
Now the HTTPCompress module can be configured to exclude certain pages by using the "excludedPaths" tag in the web.config file. But this did not seem to work.
The cause was this:

This is the line in the HTTPCompress Module that is supposed to chop off the absolute portion of the path:

string realPath = app.Request.Path.Remove(0, app.Request.ApplicationPath.Length+1);

This works fine if your web application is not at the root. But in the Visual Studio Development Web Server (formerly Cassini), the Request.ApplicationPath always comes back as "/". In that case the above code will actually chop off the first character of the relative path.
I.e. "/WebResource.axd" will become "ebResource.axd".

The Solution:
This is ugly, but when you do development using the Visual Studio built-in web server you need to add both paths to the web.config file.

<excludedPaths>
<add path="ebresource.axd"/>
<add path="WebResource.axd"/>
</excludedPaths>

Of course another option is to modify the HTTPCompress source code and fix this.

Formatting a Column in a GridView with DataFormatString

2007-06-01T20:52:00.000-04:00

Today I came across a little gotcha with the ASP.Net GridView control.
If you have a bound column bound to a DateTime field and you want to change the formatting say from "05/30/2007 15:25:22" to "05/30/2007" then the way to do this is to use the DataFormatString parameter of the BoundField:

<asp:BoundField datafield="EVENT_DATE" headertext="Event Date" DataFormatString="{0:MM/dd/yyyy}">
<ItemStyle width="10%"></ItemStyle>
</asp:BoundField>

But this didn't seem to work for some reason. The fix is to switch off HTML encoding for the column, as explained in this Microsoft post.

So the correct code is:

<asp:BoundField datafield="EVENT_DATE" headertext="Event Date" DataFormatString="{0:MM/dd/yyyy}" HtmlEncode="False">
<ItemStyle width="10%"></ItemStyle>
</asp:BoundField>

Now it works like a charm ...

How to enable ASP applications and ASP.Net applications on WSS

2007-05-31T03:04:00.000-04:00

On a server running Windows Sharepoint Services (WSS) where WSS has taken over the default web site, ASP applications are disabled by default. Also, ASP.Net applications will not run by default since WSS imposes some serious security restrictions on the web site. See this MS KB article (828810) for details and resolution. Basically you need to set up an excluded path in the Sharepoint Services Administration page.

Object-Oriented Techniques in Javascript

2007-05-18T10:33:00.000-04:00

Here is a good MSDN article about some of the more object-oriented principles in JavaScript:
Create Advanced Web Applications With Object-Oriented Techniques.

AJAX Tips and Tricks

2007-05-16T16:09:00.000-04:00

Here is an interesting article about some AJAX internals, put together by one of the co-founders of PageFlakes. Interesting is especially the part on caching web service responses (if appropriate in your case).

Microsoft JScript runtime error: 'AjaxControlToolkit' is undefined

2007-05-14T12:53:00.000-04:00

Just ran into this weird error when trying to add an AJAX control to a web page and we spent a lot of time trying to resolve this.
Basically the web page worked fine but when moving it to the server it generated a client-side JS error: "Microsoft JScript runtime error: 'AjaxControlToolkit' is undefined".

this is the corresponding code:

Sys.Application.add_init(function() {
$create(AjaxControlToolkit.ModalPopupBehavior, {"BackgroundCssClass":"modalBackground", ...}, null, null, $get("btnNew"));
});

Google search did reveal people having similar problems but no good solution.
Then there was some good information in this thread.
Basically it turns out that the the script is being compressed under certain circumstances (like debug mode vs. non-debug) and whether the compression settings are defined in the web.config file.

Here is what fixed it for us. The important setting is the one "enableCompression='false'":

<system.web.extensions>
<scripting>
<scriptresourcehandler enablecompression="false" enablecaching="true">
</scriptresourcehandler>
</scripting>
</system.web.extensions>

Make sure you switch the compression off, since it seems it does not work, even when using IE7 like I do.

Winforms Tabbed UI using multiple forms

2007-04-23T01:12:00.000-04:00

The problem at hand was how to create a Windows Forms application that uses a tabbed UI, but where you want to put the logic into separate forms, i.e. each tab page is a separate WinForm (this is mainly to not have all the code and controls in the main page).

I found 3 main approaches to this (there are probably more, but these accomplish the stated goal without excessive coding):

1. the MDIWindowManager project (free under BSD license)

2. the DockPanel Suite project (free, from SourceForge)

3. do-it-yourself (VB.Net code)

Private Sub AddFormToTab(ByVal objForm As Form, ByRef objTabPage As TabPage)
objForm.TopLevel = False
objForm.Text = ""
objForm.MaximizeBox = False
objForm.MinimizeBox = False
objForm.ControlBox = False
objTabPage.Controls.Add(objForm)
objForm.Dock = DockStyle.Fill ' Expands the form to fill the tabpage
objForm.Show()
End Sub

Use this method in the main form to add a form to a tab page.
The do-it-yourself method is simple and works, the other 2 links with the accompanying source code provide more functionality.

Everyone's talking about RIAs now...

2007-04-17T23:36:00.001-04:00

It seems to me that the current hot acronym is RIA (Rich Internet Applications). I first read about it on Adobe's website when reading about Adobe Apollo (see my post on this). Now Rick Strahl has published a very good post about the trends we're seeing in the end user application development space. He does a great job putting things like WPF, WPF/E, Adobe Flex/Apollo, HTML/AJAX in perspective. As I said before, something is going on there that every serious developer needs to keep an eye out for...
I like one of the comments to his post (and pretty much mirrors my experiences):

"Another great read Rick. I have to admit that the last two big projects that I was on both were vb6 -> asp.net/ajax conversions and BOTH got halfway through development and were re-architected for clickonce and wpf because ajax still doesn't allow you to throw 30 infragistics web combos on a page. Some presentation layers just don't work well with html and probably never will granted time and a hardware refresh might change that.
When there's a preexisting expectation of the thick client experience, even ajax doesn't cut it. I'd like to see more of this clear separation of layers. The asp.net code behind model doesn't give you the ability to cut with clean lines where ui starts and the last layer stopped. throwing cab and things like ioc into the picture just complicate things. I'm all for the service model. I think Flash is there but they never got it right for the developer. It wasn't until flex builder that they released something with intellisense. Flex is nice but it just adds more overhead and is an abstraction for people who aren't core coders. ..."

SQL Server BLOB datatypes going away

2007-04-10T11:13:00.000-04:00

This is something to be aware of:
It looks like the SQL Server datatypes TEXT, NTEXT, IMAGE are going away sometime in the future as noted in SQL server Books online: "ntext, text, and image (Transact-SQL)".

So for any new tables that need to store large data fields, M$ is suggesting to use VARCHAR(MAX), NVARCHAR(MAX), and VARBINARY(MAX).

Adobe Apollo

2007-04-05T04:06:00.000-04:00

A colleague of mine pointed out Adobe Apollo to me.
This is a very interesting technology and just confirms the trends that seem to be crystallizing in the application development space.
- pure web applications are reaching their limits in terms of usability
-> Web 2.0 wants to address that with AJAX, but the underlying protocols/languages (HTML) are just too old
- the large deployment of existing browsers, different browser technologies and the security implications that lead to tighter browser security limit what can be delivered to the user even using Web 2.0
- the user wants a seamless experience with applications that are powerful and allow desktop access and disconnected operation

-> It seems that the major players in this field are realizing this and the solution offered is a completely new "browser" - a new runtime to host new and improved content and make it feel more like a desktop application (speed, access to local file system and apps, disconnected operation)
- Microsoft introduced WPF/E as a new runtime to run XAML applications
- Adobe is working on Apollo (synergy between Flash, PDF, HTML, JavaScript, Ajax according to their web site)

On a related note, Microsoft's Click-Once technologies try to address the deployment and maintenance problems that plague desktop applications.

So basically the convergence of these technologies is targeted to the enhanced user experience. The user wants the best of both worlds:
- web app's ease of deployment, always up-to-date, highly portable
- desktop app's speed, UI features, disconnected mode, access to local system resources

We'll have to see how this pans out, but this is definitely something that seems to be here to stay and I think we haven't seen the last of this.
Especially if Adobe manages to create their Apollo runtime for the Windows Mobile and Linux platforms (and maybe Symbian/PalmOS devices) this might be a technology that can catch on.

But in general, for me as a developers this means to be aware of this trend and keep up with the technologies involved

ASP.Net Cache clarifications

2007-04-05T04:02:00.000-04:00

Tess from MSDN has a very good post on some common ASP.Net Cache pitfalls and misconceptions here.

Yahoo Pipes

2007-03-04T15:26:00.000-05:00

This seems very interesting.
[Yahoo! Pipes] Pipes is a free online service that lets you remix popular feed types and create data mashups using a visual editor. You can use Pipes to run your own web projects, or publish and share your own web services without ever having to write a line of code.

This is an interesting application concept just launched by Yahoo.
Still trying to get a handle on the possibler implications and the types of applications you can build with this, but it seem like a very powerful concept for business intelligence/data mining type of things and to combat the "information overload". More information here on TechCrunch.

Back from vacation

2007-03-04T15:25:00.000-05:00

Alright, back to work after a week in Jackson Hole, skiing.

Copy data between 2 SQL servers

2007-02-19T18:58:00.001-05:00

Using the BCP utility that comes with SQL Server 2000/2005 you can quickly export data from one SQL server installation and import it into another. This is described on MSDN.

The tricky thing is to get the command line parameters right, you need to specify the -S argument if you have multiple or named instances of SQL server installed.
Example:
bcp Northwind.dbo.Authors out C:\Temp\DataExport.dat -n -T -S MPDESKTOP\SQL2005

Otherwise you will get stupid errors such as: "NativeError = 18456 .... Login failed for user xxxx" ...

Then the import is pretty simple, you can use Query Analyzer (or SQL server Management Studio) to run this query:

USE Northwind
GO
BULK INSERT Authors
FROM 'G:\Transfer\Tempfiles\DataExport.dat'
WITH (DATAFILETYPE='native');
GO

Class Logging and tracing - approach using custom attributes

2007-02-16T10:25:00.000-05:00

If, for debugging purposes, you want to see what is going on in your .Net code, one approach would be to add something like

Log.Debug("FindCustomers -> enter method")

Into each method you are interested in.
Another, more generic and actually pretty cool approach would be to "instrument" your classes using custom attributes.
A sample approach is shown here. (Overlook the repeated and dorky use of the term "spy" :) ).

The drawback is that using the above approach, your classes would have to inherit from a common base class ... but maybe there is a way around that and just use the attribute ...

SQL Server Performance Analysis and Tuning

2007-02-16T10:11:00.000-05:00

Came across an interesting post today about using SQL Profiler to analyze performance issues in SQL Server. More can be found here.
Basically the author provides a custom SQL Profiler template and then a set of stored procs to analyze the output of the captured data for long-running stored procs and most cpu-intensive stored procs etc.

Incidentally, the author (Vyas) has a pretty good web site for everything SQL Server related.

Enjoy!

HTTP Streaming - interesting alternative to polling

2007-02-15T18:18:00.000-05:00

Triggered by a question that came up about how to create a web page that shows data dynamically without user interaction (like a stock ticker, weather conditions etc.), I came across this post that explains HTTP Streaming.
The obvious answer would be to do "polling" having some Javascript timer on the page that makes a periodic XMLHTTPRequest to get data back to the page.
HTTP Streaming is an interesting alternative.
It is also interesting that apparently IE does not send the response to an XMLHTTPRequest back unless the request is complete, so the article also describes a clever way around that.
The main drawbacks I can see are bandwidth and the required resources on the server, basically one open connection (or thread) per connected client.

VS2005 SP1 - bloat in the Solution (.sln) file

2007-02-09T09:36:00.000-05:00

Just ran across this, when adding a new file to a Visual Studio 2005 solution, now the solution gets all these additional entries for each project:

ProjectSection(WebsiteProperties) = preProject
Debug.AspNetCompiler.Debug = "True"
Release.AspNetCompiler.Debug = "False"
EndProjectSection

And these are not even web site projects, just regular DLLs (Class Library) projects used from a Web Application Project (WAP).

What is going on? Looks like this was a "feature" introduced with SP1. At least I am not the only one seeing this.

Call me old fashioned, but I don't like it ...

To NOCOUNT or not to NOCOUNT .. that is the question

2007-02-07T20:33:00.000-05:00

Well, there has been an ongoing debate whether it is good practice to use "SET NOCOUNT ON" in SQL Server to reduce the network traffic.

I think if you are running UPDATE and DELETE statements or stored procedures where you don't expect any results back or have output parameters that contain the outcome of the stored procedure, it probably makes sense to include it.

There's a post by Jon Galloway that looks at this as well and argues that the RecordsAffected is hardly used anymore in ADO.net and with SqlDataReaders.
So the bottom line is: use SET NOCOUNT ON if you don't need to have the RecordsAffected as part of your business logic.

ASP.Net Cache - cached items disappearing

2007-02-06T11:52:00.000-05:00

Sometimes when working on my local machine, items that I put into the ASP.Net Cache would just seem to disappear immediately from the Cache, defeating the purpose of caching. When hooking in the "CacheItemRemovedCallBack" in the add method, the reason the items were removed from the Cache was "underused".
Basically I was running into the same issue described here. It seems like the Cache was working as expected, it just "thought" that I had not enough memory left to cache any items.

One solution that was suggested on the web is to "disableMemoryCollection" for the cache as described here.

I think that would be acceptable on a developer's machine for debugging, but not for a production server, because again, letting the Cache manage it's own memory seems the better approach here.
The other option is to add the items to the Cache with a "notRemovable" priority. That also seems like asking for trouble, because then ASP.Net is forced to keep stuff in the Cache even if that memory was better used for serving a spike in user requests for instance.

There are a few settings that control the ASP.Net Cache's policies on reclaiming space and purging items settings: http://forums.asp.net/thread/1199949.aspx

In search of: Extensible web service framework

2007-02-03T16:30:00.000-05:00

I am looking for a good approach to create a web service that is pretty generic and can be extended. Requirements:
- easy to add new functionality
- multiple clients can hit this web service, clients can be on different software versions, new available functionality should not break older clients.

I found this interesting article "A web service as a framework for simplifying development and deployment of business functions". Somewhat against the "true" tenets of designing web service contracts etc., but might fit the bill for what I need.
The input and output parameters of this generic web service are typed datasets, and the business assemblies are loaded using reflection based in a service name given in th request.
The disadvantage is that the functionality is not explicitly described in the web service contract, it needs to be implicitly known by the client and the server (business logic assembly) based on the service name passed in. This keeps the web service interface constant when new functionality needs to be added (versioning is not a problem this way).

Insufficient system resources exist ... what's going on?

2007-02-02T23:12:00.000-05:00

So finally today I got my new Seagate Barracuda 320 GB hard drive, put it into a USB 2.0 enclosure and started copying files (I mean thousands of files) onto it. After a while I get the following error "Insufficient system resources exist to complete the requested service." I am running Windows XP Pro, SP2.
Great.... just what I need...
Bad drive?
USB enclosure bad?
So I did some searching, increased my page file size, turned off any background programs, reboot, reboot .. no avail.
I finally found this article by Microsoft "Backup program is unsuccessful when you back up a large system volume" ... I applied the first registry change (PoolUsageMaximum) with a setting of 60 and that did the trick!
I mean how on earth are you supposed to know that there is some system internal kernel memory limit of 160 MB? Well well ... seems to be working fine now.

Hello Blog

2007-02-02T23:02:00.000-05:00

Hi there,
I am actually creating this blog to keep stuff around that I think I might want to look up later on again.
Well, and maybe something in here will be useful for someone else ...

On that note, let's get started ...