I really like the spreadsheet functions added to ColdFusion 9. It makes my life so much easier but I discovered an annoyance with the spreadsheetFormatColumn function today. It would seem that you have to set the column formats after you add data to a spreadsheet. If you attempt to set it before calling spreadsheetAddRows it will set the column format to default. Not cool.

I've finally started playing with Railo and tried installing it on my Mac with Snow Leopard installed. I wasn't able to get it to run initially but had to make two quick changes to get it running:

1. Give the current user (the user under which you are currently logged in) Read + Write access to the entire* Railo folder, including all the sub folders.
2. Change the default port for Tomcat from port 80, to port 8080 since I already had Apache running on port 80. To change the port, edit /Railo/Tomcat/conf/server.xml and change the connector port.

I have largely ignored Railo in the past but I am really eager to play around with it and get some stuff deployed on this platform.

* Note that I am using Railo in a development environment so I gave full Read + Write access to the entire Railo folder, in a production set up this would definitely not be a wise thing to do. I don't think this would be a problem in most development environments since the user under which Tomcat would be running would usually have the correct permissions.

We came across an error today with our drop down menu system that uses a PNG-24 semi transparent drop shadow image around the border where the transparency would appear black in IE 7 and IE 8. After searching and trying all possible fixes we found the solution to the problem and it was quite simple.

Our menu system uses jQuery (doesn't everything these days?), and had a nice fade in and fade out transition. jQuery handles the fade transitions by setting the opacity which IE does not like very much. So using the fadeTo() functions in jQuery is a no-no in IE. The solution, use hide() and show() instead. It's not as elegant but the transparency issue was fixed on all modern browsers.

Other solutions to the problem include:

1. Using a background colour instead of transparent on the style so you would do:

.my-transparent-stuff{background: #fff url('image.png') repeat-y scroll left top;}

instead of

.my-transparent-stuff{background: transparent url('image.png') repeat-y scroll left top;}

2. Using PNG-8/transparent gifs (hey, it's a solution)

3. Forcing IE8 into IE7 mode by adding the following meta tag:

<meta http-equiv="X-UA-Compatible" content="IE=7" />

I still can't understand what Microsoft is doing!

For the past few weeks I've been incognito due to some memory leak issues we've been having with our new app. It is essentially a rewrite of our existing web application using Object Oriented techniques and embraces the Model-View-Controller paradigm. It really is a pretty little thing but unfortunately she crumbled under the weight of the world wide web. Anyone who has faced the memory leak problem will know that it is not an easy one to crack and it takes time to determine the exact issue. There are a lot of articles around that have excellent information which were all very helpful in my quest for a solution.

The system made a lot of use of the session and application scope for caching objects which was the first issue that we had to overcome. It seemed like a good idea, you've got loads of memory, you have a finite amount of objects that can be called for each session why not persist them. The problem is that ColdFusion 8 seems to have an issue with complex objects (i.e. CFCs) stored in the session and application scopes. The reason I say this is that we were seeing a very, very strange thing happening to the memory on our server. When load testing was run, the server was fine, the memory steadily increased until the initial sessions began expiring and then the average of memory usage plateaued, which is what you like to see. However, once the load test ended the memory steadily increased until it crashed the CF instance. Weird right? And so the search for a solution began. I came across a few helpful articles:

http://www.ghidinelli.com/2009/07/16/finding-memory-leaks-coldfusion-jvm

http://www.schierberl.com/cfblog/index.cfm/2006/10/12/ColdFusion_memoryLeak_profiler

http://www.alagad.com/blog/post.cfm/troubleshooting-coldfusion-performance-analysis-part-ii

These were tremendously helpful in assisting me in finding the solution. The last post from Alagad was the one that helped cure my issue in the end. You need to ensure that when making copies of persistent scoped variables that they are deep copied or used in a local scope within CFC functions. However, bear in mind that there are many causes for memory leaks and you should spend the time in figuring out the exact cause of your problem. I found the MAT tool supremely useful.

Here are some tips for curing memory issues:

1. Install cumulative hotfix 4 for ColdFusion 8.0.1 (Get it here)
2. Update the JVM to the latest provided by Sun, in my case it was JDK 1.6.0_18 (Get it here)
3. Add the -XX:+AggressiveHeap option to the JVM configuration (Read about it here)
4. Set your min and max heap to the same size to reduce the number of garbage collection calls
5. Run varscoper against your code and ensure all local variables are var scoped (Get it here)
6. Limit the use of variables scope within objects, use the THIS reference instead
7. Limit the number of complex objects (cfcs) being stored in SESSION and APPLICATION scopes
8. Clear the variables scope onRequestEnd (this doesn't really work when using Application.cfc though)
9. Run load tests! We used WCAT for Windows (Get it here)
10. Turn off CF monitoring use FusionReactor (or something similar) (Get FusionReactor here)

Hopefully these will help someone else going forward.

UPDATE 16/05/2010: Point #6 should be, ensure you scope your variables correctly. The THIS scope has its own set of limitations. Ensure that all variables (including loop indices) have the proper scope to avoid leakage.

Every so often there is a tiny problem that has you scratching your head until you RTFM. I love JSON, it's totally awesome and the fact that you can not convert CF objects natively is even better! I ran into a small issue where I was using serializeJSON on a structure that contained a query object (don't ask!). The problem was when the serialized string was deserialized using deserializeJSON the query was no longer a query, it was not a structure! It turns out that the serializeJSON function takes two parameters!

#SerializeJSON(var[, serializeQueryByColumns])#

The second optional parameter serializeQueryByColumns tells CF to handle queries in a special way. Now the trick is to remember to use the second parameter of the DeserializeJSON function which performs the reverse operation. The second parameter must be set to false for the query object to be recreated during deserialization.

Here are links to the serializeJSON and deserializeJSON in LiveDocs.

I've not posted anything on my blog for a while, it always amazes me how the top bloggers in the ColdFusion world find the time to post almost daily about tips, tricks, resources and I hardly every find the time to write a note to myself. My posts don't seem as interesting or as insightful as some of the ones posted by the CF elite. I do thank them for their great posts and continued support of the ColdFusion community.

I've been working on a website recently that has soaked up all of my time. I've been having some problems with memory leaks and JVM tuning but I think I've finally found solutions to my problems and will be posting them in a separate article shortly which will hopefully help someone out there.

I've discovered an odd little "bug" in the Fix and Int functions in ColdFusion 8. The Fix/Int functions work similarly to the Floor function in other languages:

According to the ColdFusion 8 LiveDocs

Int - Calculates the closest integer that is smaller than number. For example, it returns 3 for Int(3.3) and for Int(3.7); it returns -4 for Int(-3.3) and for Int(-3.7)

Fix - Converts a real number to an integer. If number is greater than or equal to 0, the closest integer less than or equal to number. If number is less than 0, the closest integer greater than or equal to number.

Now, if you do #Fix(15)# or #Int(15)# the functions return the correct value of 15. However if you do #Fix((6.84/45.60) * 100)# or #Int((6.84/45.60) * 100)# the functions return 14 which is incorrect since the equation equates to 15.

Bug or Feature?

One of the reasons I love Adobe's ColdFusion so much is the fact that it is built on a Java engine and you are able to use a lot of the powerful features of Java from CF. I however don't get to use this feature often enough, mainly because most of the things I work on daily doesn't really need anything other than what is provided by the CF natively. And, well, as with anything without practice your skills get dull, so when I had to access a mailbox that is hosted by Gmail using CFPOP I was forced to turn to Google to find a solution.

CFPOP does not support SSL/TLS connections as of version 8, which is quite a big limitation since so many services now support SSL for POP connections. There are quite a few options for work arounds for this but the simplest and quite elegant solution is the one provided by Anuj Gakhar. This solution uses the underlying Java pop service which does support SSL.

 

<cfset javaSystem = createObject("java", "java.lang.System") />

<cfset jProps = javaSystem.getProperties() />

 

<cfset jProps.setProperty("mail.pop3.socketFactory.class", "javax.net.ssl.SSLSocketFactory") />

<cfset jProps.setproperty("mail.pop3.port", variables.popPort) />

<cfset jProps.setProperty("mail.pop3.socketFactory.port", variables.popPort) />

 

 

Set variables.popPort to the port on which your POP server is accessed. You then call the CFPOP tag as you would normally:

<cfpop action="getHeaderOnly"

            server="#variables.popServer#"

            port="#variables.popPort#"

            username="#variables.popUsername#"

            password="#variables.popPassword#"

            maxrows="5"

            timeout="60"

            name="variables.popRecords" />

The underlying Java platform can allow you to perform many tasks that may not be available in ColdFusion, so why not do some experiments?

This is a trivial post but Paypal integration has been a headache over the past few years which the manuals having incorrect information, differences between the UK and US apis and hugely unhelpful error codes. Things have gotten a bit better in recent times but still not as good as it should be given the proliferation of Paypal integration. We recently had a little issue that had me banging my head against my keyboard. Now this IS in the api specification but I think this is a bit absurd.

Apparently, you need to specify the amount as a decimal number to two decimal places otherwise the amount is flagged as invalid. So you must give your amount value as xx.xx and not xx.xxx or any other number of decimal places. You will receive an INVALID AMOUNT error and the transaction history in Paypal Manager will show INVALID AMOUNT $0.00 USD, even if you are using another currency.

As part of PCI compliance our servers were run through third party security auditing and one warning we received was "Missing Secure Attribute in an Encrypted Session (SSL) Cookie". This warning referred to the JSESSIONID cookie being set in our SSL enabled pages not having the SECURE attribute set. In ColdFusion there is no way for you to do this programatically (since you would not explicitly create the JSESSIONID cookie) or even via the administrator. After a lot of searching and reading I found the solution thanks to comment on this post:

http://www.bennadel.com/blog/785-Ask-Ben-Hiding-Encrypting-ColdFusion-CFID-And-CFTOKEN-Values.htm

The solution is quite simple, add:

<cookie-config>
<cookie-secure>true</cookie-secure>
</cookie-config>

after the </persistence-config> element in your jrun-web.xml file which is usually located in C:\JRun4\servers\yourservername\cfusion-ear\cfusion-war\WEB-INF\jrun-web.xml. If you are running in multiserver mode of CF Enterprise and have multiple application instances, you must add this to the jrun-web.xml of every application instance.