I came across Mongoose for Node.js. It looks like a promising project but I ran into a bug as soon as I started playing with a simple counter program. The problem is in the implementation QueryPromise's atomic functions. Here is a sample program that updates a counter. The three update forms below should all be identical, only the first seems to work with the version I was playing with.
// Simple test program to show a problem in QueryPromise
// ['inc','set','unset','push','pushAll','addToSet','pop','pull','pullAll']
var sys = require('sys')
var mongoose = require('mongoose/').Mongoose
var db = mongoose.connect('mongodb://localhost/test');
var Simple = mongoose.noSchema('test',db);
Simple.drop();
//should only be one....
var m = new Simple({name:'test', x:0,y:0}).save()
// these should behave the same
Simple.update({name:'test'},{'$inc':{x:1, y:1}}).execute();
Simple.update({name:'test'}).inc({x:1, y:1}).execute();
Simple.update({name:'test'}).inc({x:1}).inc({y:1}).execute();
Simple.find({name:'test'}).each(
function (doc) {
sys.puts(JSON.stringify(doc));
}
).then(
function(){ // promise (execute after query)
Simple.close(); // close event loop
}
);
Here is a fixed version of QueryPromise's atomic functions that place the command and arguments in the correct place.
// atomic similar
['inc','set','unset','push','pushAll',
'addToSet','pop','pull','pullAll'].forEach(function(cmd){
QueryPromise.prototype[cmd] = function(modifier){
if(this.op.name.charAt(0) != 'u') return this;
if(!this.op.args.length) this.op.args.push({},{});
if(this.op.args.length == 1) this.op.args.push({});
for(i in modifier) {
if(!(this.op.args[1]['$'+cmd] instanceof Object)) this.op.args[1]['$'+cmd] = {};
this.op.args[1]['$'+cmd][i] = modifier[i];
}
return this;
}
});
]]>
easy_install ngram
build file with all the city and state names one per line, place in citystate.data Redwood City, CA Redwood, VA etc
Experiment ( the .2 threshold is a little lax )
import string
import ngram
cityStateParser = ngram.NGram(
items = (line.strip() for line in open('citystate.data')) ,
N=3, iconv=string.lower, qconv=string.lower, threshold=.2
)
Example:
cityStateParser.search('redwood')
[('Redwood VA', 0.5),
('Redwood NY', 0.5),
('Redwood MS', 0.5),
('Redwood City CA', 0.36842105263157893),
...
]
Notes: Because these are NGrams you might get overmatch when the state is part of a ngram in the city i.e. search for "washington" would yield Washington IN with a bette score than "Washington OK"
You might also want read Using Superimposed Coding Of N-Gram Lists For Efficient Inexact Matching (PDF Download)
If this works for you, consider giving me a vote on StackOverflow.com
]]>I was concerned to see that SQLite was deprecated in movabletype 5.0, but I went ahead and upgraded my blog. I followed the standard procedure, copy the new version over the old version then run the mt-upgrade.cgi via the browser. The upgrade script never made it to migrating the database. When this happened I just used the "Upgrade a large database" instructions
$ export MT_HOME=/var/local/mv
$ cd $MT_HOME
$ perl ./tools/upgrade --name superuser
upgrade -- A command line tool for upgrading the schema for Movable Type.
* Upgrading database from version 4.0070.
* Upgrading table for Website records...
* Upgrading table for MT::Entry::Summary records...
* Upgrading table for entry_rev records...
* Upgrading table for Entry records...
* Upgrading table for Asset Placement records...
* Upgrading table for Session records...
* Upgrading table for MT::Author::Summary records...
* Upgrading table for User records...
* Upgrading table for template_rev records...
* Upgrading table for Template records...
* Upgrading table for Permission records...
* Upgrading table for Comment records...
* Rebuilding permissions...
* Rebuilding permissions... (100%)
* Updating existing role name...
* Populating new role for website...
* Migrating mtview.php to MT5 style...
* Assigning new system privilege for system administrator...
* Assigning to jason...
* Updating existing role name...
* Populating new role for theme...
* Upgrading Asset path informations...
* Classifying blogs...
* Classifying blogs... (100%)
* Merging dashboard settings...
* Merging dashboard settings... (100%)
* Migrating existing 1 blog into websites and its children...
* Generated a website http://mischievous.org/
* Moved blog Pseudointellectual Appendification (http://www.mischievous.org/) under website mischievous.org
* Creating new template: 'Comment Listing'.
* Database has been upgraded to version 5.0016.
Upgrade complete!Thankfully, the PDFs are on the CD
and you do not need to run the application to see the content, just navigate to
/Volumes/CA Math 4/support/PDF/docs and you will find the PDF for each individual chapter.
On Mac or Windows, there is no need to install or run any application from the disc, If you
are running Windows, download the latest Acrobat, don't install the antiquated version on the disc.
Printing is another matter, you can't. The chapters are password print protected. I'm not a lawyer but I read the standard shrink wrap licensing agreement that came with the software and here is what I found:
COPIES. Copies can be made only as authorized above in machine readable form. Print copies of Software code are not authorized. All copyright and trademark notices must remain on all copies. All copies must be faithful reproductions. You are solely responsible for the content, quality and operation of all Software copies. Certain Software programs may be "copy protected" by special encryption coding that prevents copying or printing-out content
And
You may also make one (1) back- up copy of the Software for archival purpose
Great, I choose to backup the PDF portions of the "software" by printing on paper. Here is my "backup" program, you just need GhostScript from macports.
#!/bin/bash -x
for i in "$@"; do
NAME=`basename "$i"`
gs -q -dNOPAUSE -dBATCH -sDEVICE=pdfwrite -sOutputFile="$NAME" -c .setpdfwrite -f "$i"
lpd -d "SCX_4500" "$NAME"
rm $NAME
done
]]>
If you manage to find link on the plsinfo.org website you will find that the proxy url is incorrect.
Here is the correct link Safari Books Online, you need your library card.
Read away.
You can also see a list of all the resources you can access via your library card.
]]>All things spring up and there is not one which declines to show itself.
They grow and there is no claim made for their ownership.
The go through their processes and there no expectation of a reward for their results.
The work is accomplished, and there is no resting in it as an achievement.
The work is done, but how no one can see. 'Tis this that makes the power not cease to be.
Everyday we do things in our daily life that we perceive as socially responsible, yet our actions sometimes invisible. These invisible things add up and the actions of one person can truly make a difference.
]]>mdworker[473]: Unable to use font: no glyphs present.
/System/Library/Frameworks/ApplicationServices.framework /Frameworks/ATS.framework/Support/ATSServer[474]: Serious problems were found in font data while activating it.
/System/Library/Frameworks/ApplicationServices.framework /Frameworks/ATS.framework/Support/ATSServer[474]: You may encounter drawing or printing problems.
Well, it could be Spotlight trying to index a bad PDF file. To find the offending file with use lsof and the process id of the mdworker process
lsof -p 473
In my case it was a PDF from the hadoop 20.0 release
]]>main in the python program.
#!/usr/bin/env python
# encoding: utf-8
import sys
def input(theFile, pipe):
"""
pushes a file a line at a time to a coroutine pipe
"""
for line in theFile:
pipe.send(line)
pipe.close()
@coroutine
def extract(expression, pipe, group = 0):
"""
extract the group from a regex
"""
import re
r = re.compile(expression)
while True:
line = (yield)
match = r.search(line)
if match:
pipe.send(match.group(0))
@coroutine
def sort(pipe):
"""
sort the input on a pipe
"""
import heapq
heap = []
try:
while True:
line = (yield)
heapq.heappush(heap, line)
except GeneratorExit:
while heap:
pipe.send(heapq.heappop(heap))
@coroutine
def group(groupPipe, pipe):
"""
sends consectutive matching lines from pipe to groupPipe
"""
cur = None
g = None
while True:
line = (yield)
if cur is None:
g = groupPipe(pipe)
elif cur != line:
g.close()
g = groupPipe(pipe)
g.send(line)
cur = line
@coroutine
def uniq(pipe):
"""
implements uniq -c
"""
lines = 0
try:
while True:
line = (yield)
lines += 1
except GeneratorExit:
pipe.send('%s\t%s' % (lines, line))
@coroutine
def output(theFile):
while True:
line = (yield)
theFile.write(line + '\n')
def main():
input(sys.stdin,
extract( r'^([^ ]+)',
sort(
group( uniq,
output(sys.stdout)
)
)
)
)
if __name__ == '__main__':
main()
You can achieve the same results with the unix command line:
cat access.log | cut -d ' ' -f 1 | sort | uniq -c
#!/usr/bin/env python
# encoding: utf-8
import time
import twitter
def coroutine(func):
"""
A decorator function that takes care of starting a coroutine
automatically on call.
see: http://www.dabeaz.com/coroutines/
"""
def start(*args,**kwargs):
cr = func(*args,**kwargs)
cr.next()
return cr
return start
@coroutine
def statusPrinter():
"""
Just prints twitter status messages to the screen
"""
while True:
status = (yield)
print status.id, status.user.name, status.text
def followStatus(twitterGetter, target, timeout = 60):
"""
Follows a twitter status message that takes a since_id
"""
since_id = None
while True:
statuses = twitterGetter(since_id=since_id)
if statuses:
# pretty sure these are always in order
since_id = statuses[0]
for status in statuses:
target.send(status)
# twitter caches for 60 seconds anyway
time.sleep(timeout)
def main():
api = twitter.Api()
followStatus(api.GetPublicTimeline, statusPrinter())
if __name__ == '__main__':
main()
]]>