LightCharts

A lightweight line-chart library for Flex.

Background

I created LightCharts for a project of mine that involves tracking many stock market symbols. Originally I was using the Adobe Flex Charting library, but found that performance suffered greatly given the number of charts I was using (around 60+), the amount of data displayed, and the constant real-time updates. Of course this isn’t necessarily due to poor coding on Adobe’s part, it’s just that their library contains an amazing amount of features to handle a variety of needs, consequently it’s very heavy. I didn’t need a lot of features, just a nimble way to display data.

I searched the Internet for other charting libraries which I could use and stumbled across a fantastic set of components created by Keith Peters called Minimal Comps. Keith’s library is extremely lightweight and it would have been a good fit, but MinimalComps is geared towards the pure Flash environment and not Flex – a major issue being the disparity in the component lifecycle.

Nonetheless, I was inspired by his code so I decided to use it as a starting point, adding and changing what I needed along the way.

Features

The result is a charting library that has many new features and several new object classes, some for visual enhancements and others for displaying and interacting with data. For instance, the data series class gives the ability to display multiple lines on a graph. The Toolset architecture is useful for creating mini plug-ins which can annotate or interact with data, all without needing to change any of the charting base classes.

Also, the line-chart class can be subclassed to create new line-chart types which have different visual characteristics or behavior. Included are a couple of examples for charts which I used in my project – these include the MACD and Stochastic. Note: These examples show how to make visual and behavioral changes to the base class, not how to calculate the values for the MACD or Stochastic charts. Those formulas can be easily found online.

Screenshot

In the screenshot above you can see many of the features:

• Three different charts (standard, MACD, and Stochastic), displaying different backgrounds including gradients and alphas, line colors, value ranges, etc.
• On the first chart, the display of crosshairs and coordinate value on mouseover; all charts have this functionality.
• On the first and second charts, a custom plug-in called DotDisplayTool which displays a dot over the last data point in the series. DotDisplayTool is an example of a non-interactive plug-in.
• On the second and third charts, a custom plug-in called LinearDrawTool which allows you to draw on top of the data; it displays a line and the chart values which correspond to the beginning and ending points. LinearDrawTool is an example of an interactive plug-in.

Live Demo & Source

If you want to see the library in action, click on the following link: LightCharts live demo.

The source is covered under the MIT license and it’s currently available from the live demo “View Source…”.

There is a problem with these keys, however, if they are not truly random. This is detailed in a paper I stumbled upon entitled “Brute-Force Exploitation of Web Application Session IDs” by David Endler. It covers ways in which these keys can be “hacked” because they are not unique, but rather follow some sequence which can be guessed. He lists some major websites which he was able to get access to information that should have been private.

The paper got me thinking about how to generate random session keys, so I created some quick Python scripts using Twisted which demonstrates my solution. (This was my first time using Twisted, so it’s very possible that there is a better way to structure the code).

Solution

The character buffer in the server is used to generate new keys.

To fill the buffer:

0. Create a list of websites which themselves deliver random web pages (eg, wikipedia)
1. Select a website from random and ask for a random page
2. Grab the data within the HTML body tags and put that string in the character buffer
3. When the buffer needs more data, go back to 1.

To generate X number of keys:

0. Grab two random lengths of the character buffer. Use one to re-seed the random generator and the other as the basis for the new session key. Create the session key using MD5 and the key seed
1. Update() the current MD5 session key using a generated random character / string
2. Add that key to the buffer.
3. When the key buffer needs more keys, go back to Step 1. For every Y number of keys generated, go back to Step 0.

Notes

We don’t use a a new seed for each MD5 session key because the buffer will be emptied too quickly. Of course, the settings for the buffer size, etc could be tweaked.

Performance

Running the server code on my Mac Mini (2.16GHz Dual Core) and 5 clients on another machine, I was able to service ~8000 keys/sec (~750 million keys/day).

Conclusion

My experiment satisfied my curiosity and answered the questions from my own project.

There are, of course, many tweaks that can be made. Send me the code changes to your favorites and I’ll include them.

Click to download the client server files.

Resources

• Brute-Force Exploitation fo Web Application Session IDs (PDF)

One example app which helped me greatly was from a blog posting by Ely Greenfield. If you’re interested, you can view it on his website: chart annotation demo.

Unfortunately, the code you can download from his site is a little old so it has problems compiling in Flex Builder 2+. I have updated the code, fixed some bugs in it and have it available here: download OverlayDemo-fixed.zip.

Ely has other interesting demos on his site which are worth checking out. Some of my favorites are: the variable radius pie chart demo, the interactive bubble chart demo, and the dashed lines demo.

Resources

annotation example by Ely Greenfield

• http://www.quietlyscheming.com/blog/2006/04/03/custom-chart-annotations/
• demo: http://demo.quietlyscheming.com/overlayDemo/index.html

annotation example by Brendan Meutzner

• http://www.stretchmedia.ca/blog/index.cfm/2007/3/28/Chart-Milestones-using-annotationElements
• demo: http://www.stretchmedia.ca/code_examples/chart_milestone/main.html

Normally one would simply follow the Metakit installation instructions, but they are old and didn’t work correctly with 10.5 Leopard. I scraped enough information together from the Internet to get it working, but I had to do a lot of research. To save others the same hassle, I have put together all of the changes and put them here in their entirety:

Building Metakit

Make sure you have Xcode installed on your system before starting.

Get the latest source from the Metakit downloads page. At this time the latest version is metakit-2.4.9.7.tar.gz.

Uncompress the archive in a work directory and run the following commands:

> cd builds
> ../unix/configure --with-python=/System/Library/Frameworks/Python.framework/Versions/2.5

Note: Your Python install might be in a different location. If so, give the --with-python arg the proper value.

“Fat” binary setup

If you need this to run on the PPC architecture you will need to make a couple of modifications to ./builds/Makefile after running configure, otherwise you can skip this step and build the binaries with make.

Find CXXFLAGS = $(CXX_FLAGS) and change to the following:

CXXFLAGS = $(CXX_FLAGS) -arch ppc -arch i386 -isysroot /Developer/SDKs/MacOSX10.5.sdk

Find SHLIB_LD = g++ -dynamiclib -flat_namespace -undefined suppress and change to the following:

SHLIB_LD = g++ -dynamiclib -flat_namespace -undefined suppress -arch ppc -arch i386

Build the binaries

Run your typical Makefile commands:

> make
> make test

Installing Metakit

Rename the shared library which is now in the ./builds directory:

> mv Mk4py.dylib Mk4py.so

And copy the following files to /System/Library/Frameworks/Python.framework/Versions/2.5/Extras/lib/python (be sure to adjust the path name for your version of Python):

../python/metakit.py
./Mk4py.so

Testing Metakit

At this point you should have a working system and ought to be able to run the following command in a Python shell without issue:

>>>from metakit import *

Enjoy !

Resources

• Metakit for Python website

• helpful instructions from www.ospace.net