Hhlc hhlc.eish! → 0.5

Comments and changes to this ticket

• 

  Joao Carlos March 22nd, 2009 @ 03:31 PM

  • Milestone cleared.
• 

  Joao Carlos April 12th, 2009 @ 11:24 PM

  • Milestone set to “1.0 (The Ultimate Stable Release)”
• 

  Matias Korhonen April 21st, 2009 @ 11:40 AM

  An up to date tutorial can be found here: http://www.jumbabox.com/2008/05/...

• 

  Joao Carlos April 29th, 2009 @ 01:07 AM

  • Assigned user changed from “Joao Carlos” to “Matias Korhonen”
  • State changed from “new” to “open”
  • Milestone changed from “1.0 (The Ultimate Stable Release)” to “0.5”
• 

  Matias Korhonen April 29th, 2009 @ 01:18 AM

  • State changed from “open” to “testing”

  (from [5013c8206ce375bd040941ab7a3ecb166582ed8d]) First implementation of site search using Ferret and AAF [#11 state:testing] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 29th, 2009 @ 01:22 AM

  (from [19a89a66b5ab5900fd226feeac1c85731d7934cb]) Ignored Ferret index directory [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 29th, 2009 @ 01:35 AM

  (from [52cf1ee6ac7486268d7ddc9d4986fee8cd97906a]) Removed unpublished content from search results [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 29th, 2009 @ 01:48 PM

  (from [22258d77cbf4ec98fdf5f1bdbf647db7219f95cb]) Applied boosts to search fields [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 29th, 2009 @ 01:48 PM

  (from [9af0deaea002938c1e35c7a8f8e56b69b3224c7f]) Small twekas to the search views [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 29th, 2009 @ 01:48 PM

  (from [83fd3b61ac3ab5c0628fc31eda70487f59dcfba8]) Small improvements and fixes [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 29th, 2009 @ 02:06 PM

  (from [1f93685483944750e697235eb813919fb002490b]) Removed search from navigation, it is not ready for public consumption [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 29th, 2009 @ 02:08 PM

  In the long term, let's not use Ferret and AAF.

  From http://blogs.nitobi.com/brian/20...

  To make a long story short here’s a couple of quotes from Ezra Zygmuntowicz, of Engine Yard fame, who literally wrote the book on deploying rails applications:

  Ferret is unstable in production. Segfaults, corrupted indexes galore. We’ve switched around 40 clients form ferret to sphinx and solved their problems this way. I will never use ferret again after all the problems I have seen it cause peoples production apps. Plus sphinx can reindex many many times faster then ferret and uses less cpu and memory as well.

  Right about here you can hear me say in a western Canadian accent, “Sphinx eh..”. Ezra continues in a later post:

  We have a bunch of clients using solr as well. In general it is more powerful then sphinx but a lot slower to reindex and querey. Also it uses 50 times the memory of sphinx. If you have a box or vm to put SOLR on by itself then it is a good option as well. but if sphinx can do everything you need from a a search indexer then it is a way better option cost wise.

  [...]

  The verdict: Sphinx rocks.

• 

  Matias Korhonen April 29th, 2009 @ 02:09 PM

  • Milestone changed from “0.5” to “1.0 (The Ultimate Stable Release)”
• 

  Matias Korhonen April 29th, 2009 @ 02:13 PM

  • Tag set to “!ferret, search, sphinx, ultrasphinx”
• 

  Matias Korhonen April 30th, 2009 @ 12:12 AM

  OK, one more choice for search: Xapian

  It seems to be quite feature rich, and it supports more ddatabase systems than Sphinx. This is especially nice as it means that you don't need postgresql or mysql for development...

  Locomotivation has a tutorial.

  Other cool features:

  • Ranked probabilistic search - important words get more weight than unimportant words, so the most relevant documents are more likely to come near the top of the results list.

  • The indexer supplied can index HTML, PHP, PDF, PostScript, OpenOffice/StarOffice, OpenDocument, Microsoft Word/Excel/Powerpoint/Works, Word Perfect, AbiWord, RTF, DVI, Perl POD documentation, and plain text. Adding support for indexing other formats is easy where conversion filters are available. This indexer works using the filing system, but we also provide a script to allow the htdig web crawler to be hooked in, allowing remote sites to be searched using Omega.

  • Written in C++. Perl bindings are available in the module Search::Xapian on CPAN. Java JNI bindings are included in the xapian-bindings module. We also support SWIG which can generate bindings for many languages. At present those for Python, PHP, TCL, C#, and Ruby are working.

  • Highly portable - runs on Linux, Mac OS X, FreeBSD, NetBSD, OpenBSD, Solaris, HP-UX, Tru64, IRIX, and probably other Unix platforms, as well as Microsoft Windows.

  • Xapian can suggest spelling corrections for user supplied queries. This is based on words which occur in the data being indexed, so works even for words which wouldn't be found in a dictionary (e.g. "xapian" would be suggested as a correct for "xapain").

  • Synonyms are supported, both explicitly (e.g. "~cash") and as an automatic form of query expansion.

• 

  Matias Korhonen April 30th, 2009 @ 12:14 AM

  • Tag changed from “!ferret, search, sphinx, ultrasphinx” to “!ferret, search, sphinx, ultrasphinx, xapian”
• 

  Matias Korhonen April 30th, 2009 @ 12:29 AM

  Just ran a quick test using the Locomotivation tutorial. Well, it seems to work.

• 

  Matias Korhonen April 30th, 2009 @ 10:26 PM

  • Milestone changed from “1.0 (The Ultimate Stable Release)” to “0.5”

  (from [e47b592b8344c02d5e10f3d1138c8362c86d13e0]) Switched search to Xapian and the Xapit plugin [#11 milestone:"0.3 (Beta)"] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 30th, 2009 @ 10:30 PM

  (from [065ea8817a28c70074a30da510d570baa866f1b1]) Xapit initializer [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 30th, 2009 @ 10:30 PM

  (from [0f4eb82fff94e6b1b67dbbb9edcac4c967ca33bc]) Added xapit index to ignore list [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 30th, 2009 @ 11:48 PM

  (from [60e05101a3c55c3a1481330cede5749b7a83e4e0]) Final deferretting [#11] (or so I hope) http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen April 30th, 2009 @ 11:48 PM

  (from [91babec37da63572ea151b2f3a789e5973b532fd]) Added Xapit to the readme [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 12:55 AM

  (from [99e378a8e3e9a04ee85c9a49d4da5cbfae1b6957]) Added config option for stemming [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 12:55 AM

  (from [e057a863fa7952d0b1ec85db8d2026ce0276532a]) Fixed news search method [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 12:55 AM

  (from [c002ea39251f6ab001404630d37b443526359daf]) Added result count [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 12:55 AM

  (from [be643954f35f77db2290f3ff131566356da7cab8]) Added result count and changed quotes to for the search terms [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 12:55 AM

  (from [2f883a65d459d1b643bcfb5dccdbb90de698156f]) Removed format.xml from the Search controller [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 12:56 AM

  (from [3f34ebec8cdbec9d6e6ace0cd29279b848b5e840]) Removed respond_tos from the search controller [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 02:26 AM

  (from [06712c354de2640e7b7667d48a72fbd6e5bd61ef]) Added Search section to the readme [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 01:47 PM

  (from [c9c32e8c16024e5df074887cd3a6b6ee72705925]) Added note to README [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 07:00 PM

  • Milestone changed from “0.5” to “1.0 (The Ultimate Stable Release)”

  (from [21239c0412b473bb88cb610d96c0160a871c63b6]) Removed Search from the navigation [#11 milestone:"1.0 (The Ultimate Stable Release)"] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 1st, 2009 @ 08:21 PM

  • Tag changed from “!ferret, search, sphinx, ultrasphinx, xapian” to “!ferret, !sphinx, search, ultrasphinx, xapian”
• 

  Matias Korhonen May 2nd, 2009 @ 04:06 PM

  (from [77cec3cfd545a93306139431adc7a324a75c5d1d]) Added meta tags to the search pages. [#11 #73] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 3rd, 2009 @ 12:43 PM

  (from [67a0145e04fc27a58fdf8801804819e56dc5768d]) Added setting to enable/disable search [#11] http://github.com/k33l0r/hhlc/co...

• 

  Matias Korhonen May 3rd, 2009 @ 12:43 PM

  (from [fd126cf7b8c62f41dac9363c89d2a515d6365167]) Added OpenSearch support [#11] http://github.com/k33l0r/hhlc/co...

• 

  Joao Carlos May 3rd, 2009 @ 11:33 PM

  (from [675fd0fe1d22b6a87bd0f7df84b900e409aee714]) Don't load the Xapit plugin if search is disabled. [#11] http://github.com/jcxplorer/hhlc...

• 

  Joao Carlos May 4th, 2009 @ 12:05 AM

  (from [82d7086d1ac2211ba9eebef55314eed5b073ce6a]) No xapit in models if search is disabled. [#11] http://github.com/jcxplorer/hhlc...

• 

  Matias Korhonen May 25th, 2009 @ 04:11 PM

  (from [8e7e4d4784b54f09d80c9712fea9c0a61ec6cfe8]) Tentative support for facets for articles [#11] http://github.com/k33l0r/hhlc/commit/8e7e4d4784b54f09d80c9712fea9c0...

• 

  Matias Korhonen June 17th, 2009 @ 10:06 PM

  (from [d41d0201fbc149b99c9413d2149b3710ecb1f44a]) Updated Xapit to the latest commit [#11] http://github.com/k33l0r/hhlc/commit/d41d0201fbc149b99c9413d2149b37...

• 

  Matias Korhonen June 17th, 2009 @ 10:14 PM

  Xapit-Sync should (hopefully) soon solve the search DB update problem: http://github.com/ryanb/xapit-sync/tree/master

• 

  Matias Korhonen July 3rd, 2009 @ 01:25 AM

  (from [846035bfbf483347472ee33453866285b0cade51]) Updated Xapit to latest commit (v. 0.2.5) in preparation for xapit-sync [#11] http://github.com/k33l0r/hhlc/commit/846035bfbf483347472ee334538662...

• 

  Joao Carlos July 3rd, 2009 @ 01:27 AM

  Why don't we use the xapit gem instead?

• 

  Matias Korhonen July 3rd, 2009 @ 01:33 AM

  Apparently it's better to use the plugin, according to Ryan.

• 

  Matias Korhonen July 3rd, 2009 @ 10:51 PM

  • Tag changed from “!ferret, !sphinx, search, ultrasphinx, xapian” to “!ferret, !sphinx, !ultrasphinx, search, xapian, xapit, xapit-sync”
  • State changed from “testing” to “resolved”
  • Milestone changed from “1.0 (The Ultimate Stable Release)” to “0.5”

  Split this ticket into three distinct tasks:

  • #139 Update the Search DB Without an Application Restart
  • #140 Implement Facets for Xapit/Xapian
  • #141 Enable spelling suggestions when searching

  This is because we already have rudimentary search working and this ticket has grown too long; the slightly better organization is welcome.